Oct 30 21:14:01.502505 ip-10-0-135-205 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Oct 30 21:14:01.502516 ip-10-0-135-205 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Oct 30 21:14:01.502522 ip-10-0-135-205 systemd[1]: kubelet.service: Failed with result 'resources'.
Oct 30 21:14:01.502744 ip-10-0-135-205 systemd[1]: Failed to start Kubernetes Kubelet.
Oct 30 21:14:11.752092 ip-10-0-135-205 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Oct 30 21:14:11.752106 ip-10-0-135-205 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6010bb1540874e948575e5ba89257f9f --
Oct 30 21:16:03.445823 ip-10-0-135-205 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:16:03.873310 ip-10-0-135-205 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:16:03.873310 ip-10-0-135-205 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:16:03.873310 ip-10-0-135-205 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:16:03.873310 ip-10-0-135-205 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:16:03.877117 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877038    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.877117 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877114    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.877117 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877118    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.877117 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877121    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.877117 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877124    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877127    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877130    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877133    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877136    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877138    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877142    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877145    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877147    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877150    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877153    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877157    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877162    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877165    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877168    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877171    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877175    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877177    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877180    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877183    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.877298 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877185    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877188    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877192    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877194    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877197    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877200    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877203    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877205    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877208    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877211    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877213    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877216    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877219    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877222    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877225    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877228    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877230    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877233    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877236    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877238    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.877775 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877241    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877243    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877246    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877249    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877251    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877254    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877256    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877259    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877262    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877265    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877267    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877270    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877272    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877275    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877277    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877280    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877283    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877285    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877288    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877290    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.878243 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877293    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877295    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877298    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877301    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877305    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877308    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877311    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877313    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877318    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877322    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877326    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877329    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877333    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877335    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877338    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877341    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877344    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877347    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877350    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.878731 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877354    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877356    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877359    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877362    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877365    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877367    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877370    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877372    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877375    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877378    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877380    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877383    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877386    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877388    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877391    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877393    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877396    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877399    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877402    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.879186 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877405    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877408    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877410    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.877413    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878192    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878199    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878202    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878205    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878208    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878211    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878214    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878219    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878224    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878227    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878232    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878235    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878239    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878242    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878244    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.879680 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878247    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878250    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878253    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878255    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878258    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878261    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878263    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878266    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878268    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878271    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878273    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878276    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878279    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878282    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878285    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878288    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878291    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878294    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878296    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.880139 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878299    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878302    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878305    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878307    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878310    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878312    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878315    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878318    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878320    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878324    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878326    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878329    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878331    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878334    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878336    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878339    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878341    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878344    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878347    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878349    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.880608 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878352    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878354    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878357    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878359    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878366    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878368    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878372    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878375    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878378    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878381    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878384    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878386    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878389    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878392    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878394    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878397    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878399    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878402    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878405    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878407    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.881089 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878410    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878412    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878416    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878419    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878421    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878424    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878426    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878429    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878431    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878434    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878436    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878439    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878442    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878444    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878447    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878449    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878453    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878456    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878459    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878462    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.881564 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878464    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878467    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878469    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878472    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878475    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878477    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878479    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878482    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878485    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878487    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878490    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.878494    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879039    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879046    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879050    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879054    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879057    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879059    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879062    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879065    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.882043 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879067    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879070    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879073    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879076    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879078    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879081    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879083    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879086    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879090    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879093    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879096    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879098    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879101    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879104    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879106    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879109    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879112    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879115    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879118    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.882506 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879122    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879126    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879129    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879132    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879134    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879137    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879140    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879143    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879152    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879155    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879158    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879160    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879163    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879166    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879168    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879171    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879173    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879176    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879179    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879181    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.882979 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879184    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879188    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879191    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879194    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879197    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879200    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879202    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879205    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879208    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879210    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879213    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879216    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879219    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879221    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879224    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879227    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879229    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879232    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879235    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879237    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.883447 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879240    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879243    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879246    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879249    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879251    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879254    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879256    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879259    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879262    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879265    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879267    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879270    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879273    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879276    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879280    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879284    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879287    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879291    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879294    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.883939 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879296    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879299    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879302    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879304    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879308    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879311    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879314    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879316    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879319    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879321    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879324    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879327    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879329    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879332    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879335    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879339    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879341    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879344    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879346    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.879349    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879437    2581 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:16:03.884409 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879444    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879468    2581 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879473    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879478    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879482    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879488    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879492    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879496    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879499    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879502    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879506    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879509    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879512    2581 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879515    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879518    2581 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879525    2581 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879528    2581 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879532    2581 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879535    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879538    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879541    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879545    2581 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879549    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:16:03.884908 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879564    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879567    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879571    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879574    2581 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879578    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879582    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879585    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879588    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879593    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879596    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879599    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879602    2581 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879605    2581 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879608    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879613    2581 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879616    2581 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879619    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879622    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879625    2581 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879630    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879633    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879637    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879640    2581 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879643    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879648    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:16:03.885451 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879651    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879654    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879657    2581 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879660    2581 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879663    2581 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879667    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879670    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879673    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879676    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879680    2581 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879683    2581 flags.go:64] FLAG: --help="false"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879686    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879690    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879693    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879696    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879699    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879703    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879706    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879709    2581 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879712    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879715    2581 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879718    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879721    2581 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879724    2581 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:16:03.886107 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879727    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879730    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879733    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879736    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879739    2581 flags.go:64] FLAG: --lock-file=""
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879742    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879745    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879750    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879755    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879758    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879761    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879765    2581 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879767    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879771    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879774    2581 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879777    2581 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879781    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879784    2581 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879788    2581 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879791    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879795    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879798    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879801    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879804    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879807    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:16:03.886687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879810    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879817    2581 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879822    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879825    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879828    2581 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879831    2581 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879833    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879837    2581 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879840    2581 flags.go:64] FLAG: --port="10250"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879843    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879845    2581 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-01419f90c91d384b9"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879849    2581 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879852    2581 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879855    2581 flags.go:64] FLAG: --register-node="true"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879859    2581 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879863    2581 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879866    2581 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879869    2581 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879871    2581 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879875    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879879    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879882    2581 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879885    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879888    2581 flags.go:64] FLAG: --runonce="false"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879891    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879894    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879897    2581 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:16:03.887299 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879900    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879903    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879907    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879910    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879913    2581 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879916    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879919    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879923    2581 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879926    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879929    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879932    2581 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879935    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879941    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879944    2581 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879947    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879950    2581 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879953    2581 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879956    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879959    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879963    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879966    2581 flags.go:64] FLAG: --v="2"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879970    2581 flags.go:64] FLAG: --version="false"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879975    2581 flags.go:64] FLAG: --vmodule=""
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879979    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.879982    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:16:03.887990 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880111    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880116    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880119    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880122    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880125    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880128    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880132    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880135    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880139    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880142    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880145    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880148    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880151    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880154    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880158    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880161    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880164    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880166    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880169    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880172    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.888584 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880175    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880177    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880180    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880183    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880185    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880188    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880191    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880194    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880197    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880200    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880202    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880205    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880208    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880210    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880213    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880216    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880219    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880222    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880224    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.889075 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880227    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880229    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880232    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880234    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880237    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880240    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880243    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880247    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880249    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880252    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880254    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880257    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880260    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880262    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880265    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880268    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880270    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880273    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880275    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.889611 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880278    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880281    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880284    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880286    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880289    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880292    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880294    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880297    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880301    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880305    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880308    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880311    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880313    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880316    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880319    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880321    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880324    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880326    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880329    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.890063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880332    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880336    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880338    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880341    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880344    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880347    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880349    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880352    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880354    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880357    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880360    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880362    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880365    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880368    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880371    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880373    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880376    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880379    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880381    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880384    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.890525 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880386    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880389    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880392    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880394    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880397    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880399    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880402    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880405    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880407    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.880433    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880467    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880472    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880475    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880478    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880482    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880485    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.891024 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880487    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880490    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880493    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880495    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880498    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880501    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880503    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880506    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880508    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880512    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880514    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880517    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880520    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880522    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880526    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880531    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880534    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880537    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880540    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.891417 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880543    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880546    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880548    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880562    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880565    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880568    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880570    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880573    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880576    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880578    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880581    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880586    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880588    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880591    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880594    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880596    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880599    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880602    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880605    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880607    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.891901 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880610    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880613    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880617    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880620    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880623    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880625    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880628    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880631    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880633    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880636    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880639    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880642    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880644    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880647    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880650    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880652    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880655    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880658    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880661    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880664    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.892384 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880667    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880671    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880675    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880680    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880683    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880686    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880688    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880691    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880694    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880696    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880699    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880701    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880705    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880707    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880711    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880714    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880716    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880719    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880722    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880725    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.892887 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880727    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880730    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880732    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880735    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880737    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880741    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880744    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880746    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880749    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880751    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880754    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880756    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880759    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880762    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880764    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880768    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880771    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880774    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880776    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.893398 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880779    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.880782    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.887681    2581 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.887695    2581 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.887705    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.887710    2581 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887774    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887781    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887784    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887788    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887791    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887794    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887798    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887801    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887804    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887807    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887811    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887813    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887816    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.893851 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887819    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887821    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887824    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887827    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887830    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887833    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887835    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887838    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887841    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887843    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887847    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887850    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887853    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887855    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887858    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887861    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887865    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887867    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887870    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.894356 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887873    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887876    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887879    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887883    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887888    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887891    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887894    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887896    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887900    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887902    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887905    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887907    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887910    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887913    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887915    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887918    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887921    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887923    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887926    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.894965 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887929    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887931    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887934    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887936    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887939    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887943    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887946    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887948    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887951    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887954    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887957    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887960    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887963    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887965    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887968    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887971    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887973    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887976    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887978    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.895423 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887981    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887984    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887986    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887989    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887992    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887995    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.887997    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888000    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888003    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888006    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888009    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888012    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888014    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888017    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888019    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888022    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888025    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888028    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888032    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888035    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.895889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888038    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888041    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888044    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888047    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888050    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888053    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888056    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888058    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888061    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888064    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888066    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888069    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888071    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888074    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888076    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888079    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.888106    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:16:03.896343 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888259    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888263    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888267    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888270    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888272    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888275    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888278    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888281    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888283    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888286    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888288    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888291    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888294    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888296    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888300    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888305    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888309    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888313    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888317    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.896804 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888321    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888324    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888327    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888330    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888332    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888335    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888338    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888340    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888343    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888345    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888348    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888351    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888353    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888356    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888359    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888361    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888364    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888366    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888369    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888372    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.897295 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888374    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888377    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888379    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888382    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888385    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888387    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888390    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888393    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888395    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888398    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888401    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888404    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888407    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888410    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888412    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888415    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888417    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888420    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888423    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888425    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.898086 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888428    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888431    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888433    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888436    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888438    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888441    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888444    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888447    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888449    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888452    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888454    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888457    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888460    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888462    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888465    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888468    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888471    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888473    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888476    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888478    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.898724 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888481    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888484    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888487    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888490    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888493    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888495    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888498    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888501    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888503    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888506    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888509    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888511    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888514    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888516    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888519    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888521    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888524    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888527    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888529    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888532    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.899217 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888535    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888537    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888540    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888542    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888545    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888547    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888550    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.888589    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888625    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888630    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888633    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888636    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888639    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888641    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888644    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888647    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:03.899697 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888650    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888653    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888655    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888659    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888662    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888665    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888667    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888670    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888673    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888675    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888678    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888680    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888683    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888685    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888688    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888691    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888694    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888696    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888699    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888701    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:03.900063 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888704    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888708    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888712    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888714    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888717    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888721    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888725    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888728    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888731    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888734    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888737    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888739    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888742    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888745    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888748    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888750    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888753    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888756    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888761    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:03.900569 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888764    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888766    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888769    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888771    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888774    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888777    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888779    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888782    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888784    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888787    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888789    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888792    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888795    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888797    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888800    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888802    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888805    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888808    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888810    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888813    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:03.901010 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888815    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888818    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888820    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888823    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888825    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888828    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888832    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888834    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888837    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888839    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888843    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888847    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888850    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888852    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888855    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888858    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888860    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888863    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888866    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:03.901469 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888868    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888871    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888874    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888876    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888879    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888881    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888884    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888887    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888889    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888892    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888895    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888899    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888902    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888904    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888907    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888909    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888912    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888915    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888917    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:03.901932 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:03.888920    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:03.902378 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.888968    2581 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:16:03.902378 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.891371    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 30 21:16:03.902378 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.892271    2581 server.go:1014] "Starting client certificate rotation"
Oct 30 21:16:03.902378 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.892361    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:16:03.902378 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.892971    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:16:03.902378 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.894191    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:16:03.902378 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.901004    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:16:03.912053 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.912033    2581 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:16:03.914751 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.914736    2581 log.go:25] "Validated CRI v1 image API"
Oct 30 21:16:03.915504 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.915481    2581 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:16:03.917883 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.917862    2581 fs.go:135] Filesystem UUIDs: map[66b90b66-65b6-4c77-9bff-21775ac53be8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c3480384-a9a3-489a-94fa-c06047de1be5:/dev/nvme0n1p3]
Oct 30 21:16:03.917931 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.917883    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 30 21:16:03.922830 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.922731    2581 manager.go:217] Machine: {Timestamp:2026-10-30 21:16:03.921489756 +0000 UTC m=+0.353230997 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099293 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c1efaba34e45de2e3ba90772a227e SystemUUID:ec2c1efa-ba34-e45d-e2e3-ba90772a227e BootID:6010bb15-4087-4e94-8575-e5ba89257f9f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:18:7f:ff:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:18:7f:ff:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:50:05:67:7f:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:16:03.922909 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.922832    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:16:03.922945 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.922933    2581 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:16:03.926211 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.926189    2581 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:16:03.926338 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.926215    2581 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-205.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:16:03.926382 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.926340    2581 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:16:03.926382 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.926349    2581 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:16:03.926436 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.926384    2581 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:16:03.926436 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.926402    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:16:03.927127 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.927117    2581 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:16:03.929777 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.929765    2581 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:16:03.929893 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.929884    2581 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:16:03.930662 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.930653    2581 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:16:03.930698 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.930666    2581 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:16:03.930698 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.930677    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:16:03.930698 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.930686    2581 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:16:03.930698 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.930694    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:16:03.931037 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.931024    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:16:03.933200 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.933175    2581 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:16:03.938328 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.938312    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:16:03.939055 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939041    2581 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:16:03.939121 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939082    2581 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:16:03.939267 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939254    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:16:03.939325 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939274    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:16:03.939325 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939283    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:16:03.939325 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939293    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:16:03.939325 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939302    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:16:03.939325 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939311    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:16:03.939983 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939971    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:16:03.940040 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939985    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:16:03.940040 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.939997    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:16:03.940040 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.940007    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:16:03.940040 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.940021    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:16:03.940040 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.940035    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:16:03.941325 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.941314    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:16:03.941377 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.941328    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:16:03.944902 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.944887    2581 server.go:1263] "Started kubelet"
Oct 30 21:16:03.945017 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.944965    2581 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:16:03.945077 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.944992    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:16:03.945122 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.945079    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:16:03.945610 ip-10-0-135-205 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:16:03.945997 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.945979    2581 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:16:03.952171 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.952154    2581 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:16:03.952246 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:03.952191    2581 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 30 21:16:03.954334 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.954316    2581 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:16:03.954418 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.954393    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:16:03.954607 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:03.954544    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-205.us-west-1.compute.internal\" not found"
Oct 30 21:16:03.954970 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.954953    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:16:03.954970 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.954954    2581 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:16:03.955094 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.954981    2581 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:16:03.955094 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955089    2581 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:16:03.955175 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955100    2581 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:16:03.955384 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955367    2581 factory.go:55] Registering systemd factory
Oct 30 21:16:03.955463 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955412    2581 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:16:03.955639 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955625    2581 factory.go:153] Registering CRI-O factory
Oct 30 21:16:03.955639 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955640    2581 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:16:03.955758 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955722    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:16:03.955758 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955738    2581 factory.go:103] Registering Raw factory
Oct 30 21:16:03.955758 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.955753    2581 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:16:03.956640 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.956623    2581 manager.go:319] Starting recovery of all containers
Oct 30 21:16:03.967884 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.967866    2581 manager.go:324] Recovery completed
Oct 30 21:16:03.972406 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.972337    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:03.973918 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.973900    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:03.973994 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.973930    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:03.973994 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.973941    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:03.974369 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.974356    2581 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:16:03.974429 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.974368    2581 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:16:03.974429 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.974370    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:03.974429 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.974388    2581 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:16:03.975401 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.975388    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:03.975450 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.975405    2581 policy_none.go:50] "Start"
Oct 30 21:16:03.975450 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.975415    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:03.975450 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.975420    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:16:03.975450 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.975428    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:03.975450 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.975434    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:16:03.976343 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:03.976332    2581 policy_none.go:44] "Start"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.002482    2581 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.006203    2581 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.006230    2581 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.006241    2581 server.go:87] "Starting device plugin registration server"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.006499    2581 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.006510    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.006672    2581 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.006795    2581 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.006806    2581 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.007314    2581 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:16:04.015346 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.007362    2581 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-205.us-west-1.compute.internal\" not found"
Oct 30 21:16:04.017921 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.017179    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:16:04.018313 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.018298    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:16:04.018354 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.018319    2581 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:16:04.018354 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.018337    2581 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:16:04.018440 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.018367    2581 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 30 21:16:04.093965 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.093936    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-205.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 30 21:16:04.093965 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.093932    2581 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-205.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 30 21:16:04.095224 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.093939    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-205.us-west-1.compute.internal.18e36b37c7e867ea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-205.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-205.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:16:03.944859626 +0000 UTC m=+0.376600867,LastTimestamp:2026-10-30 21:16:03.944859626 +0000 UTC m=+0.376600867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-205.us-west-1.compute.internal,}"
Oct 30 21:16:04.106744 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.106724    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:04.108442 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.108426    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:04.108519 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.108457    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:04.108519 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.108468    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:04.108519 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.108491    2581 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.118906 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.118873    2581 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"]
Oct 30 21:16:04.119007 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.118954    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:04.119807 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.119792    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:04.119876 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.119820    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:04.119876 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.119836    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:04.120914 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.120903    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:04.121047 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.121086 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121062    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:04.121635 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121618    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:04.121635 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121632    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:04.121778 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121651    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:04.121778 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121656    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:04.121778 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121666    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:04.121778 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.121669    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:04.122632 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.122620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.122687 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.122645    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:04.123407 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.123364    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:04.123407 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.123398    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:04.123533 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.123411    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:04.156246 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.156225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61a83213484fa2827d610c578ff6f296-config\") pod \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"61a83213484fa2827d610c578ff6f296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.156337 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.156256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.156337 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.156271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.160088 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.160070    2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-205.us-west-1.compute.internal\" not found" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.164741 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.164723    2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-205.us-west-1.compute.internal\" not found" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.169183 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.169166    2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:16:04.169256 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.169222    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9lxmt"
Oct 30 21:16:04.172722 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.172708    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9lxmt"
Oct 30 21:16:04.174294 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.174273    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 30 21:16:04.174378 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.174314    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 30 21:16:04.174437 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.174331    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-205.us-west-1.compute.internal.18e36b37c9a3c633  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-205.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-205.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-205.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:16:03.973916211 +0000 UTC m=+0.405657454,LastTimestamp:2026-10-30 21:16:03.973916211 +0000 UTC m=+0.405657454,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-205.us-west-1.compute.internal,}"
Oct 30 21:16:04.174506 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.174484    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass"
Oct 30 21:16:04.248803 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.248780    2581 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-135-205.us-west-1.compute.internal\" not found" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.249709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.249695    2581 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:04.257099 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.257083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.257165 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.257106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61a83213484fa2827d610c578ff6f296-config\") pod \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"61a83213484fa2827d610c578ff6f296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.257165 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.257122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.257240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.257174    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.257240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.257180    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.257240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.257194    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61a83213484fa2827d610c578ff6f296-config\") pod \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"61a83213484fa2827d610c578ff6f296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.396754 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.396700    2581 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-205.us-west-1.compute.internal\" not found" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.449184 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.449157    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:04.450148 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.450118    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:04.450148 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.450149    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:04.450276 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.450172    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:04.450276 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.450204    2581 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.462624 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.462606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.468926 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.468810    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.506990 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.506965    2581 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.554717 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.554699    2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.624712 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.624691    2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:16:04.625639 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.625628    2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:04.682501 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.682456    2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:16:04.892304 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.892276    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 30 21:16:04.892757 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:04.892448    2581 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a307518d15e3f4f029c52010fdce43ee-4fb9e135dd735df7.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-135-205.us-west-1.compute.internal.18e36b37c9a40fb2\": read tcp 10.0.135.205:46672->3.137.65.160:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-135-205.us-west-1.compute.internal.18e36b37c9a40fb2  default   4815 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-205.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-205.us-west-1.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-205.us-west-1.compute.internal,},FirstTimestamp:2026-10-30 21:16:03 +0000 UTC,LastTimestamp:2026-10-30 21:16:04.119827534 +0000 UTC m=+0.551568780,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-205.us-west-1.compute.internal,}"
Oct 30 21:16:04.932995 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.932943    2581 apiserver.go:52] "Watching apiserver"
Oct 30 21:16:04.955619 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:04.955600    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 30 21:16:05.177045 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.177003    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:11:04 +0000 UTC" deadline="2028-08-12 05:26:40.407489438 +0000 UTC"
Oct 30 21:16:05.177045 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.177039    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15632h10m35.230453267s"
Oct 30 21:16:05.226203 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.225799    2581 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:16:05.226430 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.226406    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-blmqq","openshift-network-diagnostics/network-check-target-cmvnx","kube-system/konnectivity-agent-6pzlh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal","kube-system/global-pull-secret-syncer-2g9kx","openshift-ovn-kubernetes/ovnkube-node-j2ck7","kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal","openshift-multus/multus-44tnc","openshift-multus/network-metrics-daemon-hstlp","openshift-network-operator/iptables-alerter-7jmrh","openshift-cluster-node-tuning-operator/tuned-4l6nm","openshift-dns/node-resolver-hlvrt","openshift-image-registry/node-ca-z92xh"]
Oct 30 21:16:05.227935 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.227918    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.229017 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.228989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:05.229120 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.229079    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:05.230116 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.230100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.231056 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.231043    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.232116 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.232099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.232197 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.232166    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:05.233263 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.233250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.234523 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.234504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.235879 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.235863    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:05.235962 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.235939    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:05.237118 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.237104    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.238348 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.238331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.239587 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.239567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.240719 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.240699    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.255861 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.255839    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:16:05.261120 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-multus-certs\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.261218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f366bf9e-fcd7-4526-8370-9398ca15d07f-hosts-file\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.261218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-binary-copy\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.261218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-var-lib-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.261218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.261404 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-env-overrides\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.261404 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.261404 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jg9g\" (UniqueName: \"kubernetes.io/projected/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-kube-api-access-8jg9g\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:05.261404 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-etc-tuned\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.261592 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-serviceca\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.261592 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261477    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-etc-kubernetes\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.261592 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7tmq\" (UniqueName: \"kubernetes.io/projected/f366bf9e-fcd7-4526-8370-9398ca15d07f-kube-api-access-n7tmq\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.261592 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-systemd\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.261592 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261555    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-netns\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.261858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.261858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cnibin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.261858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261653    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-conf-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.261858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2h6f\" (UniqueName: \"kubernetes.io/projected/725fdb19-6f8c-406e-b4c4-f9b2597887ba-kube-api-access-b2h6f\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.261858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85qhr\" (UniqueName: \"kubernetes.io/projected/239b6026-1bc2-4a79-ba5f-561ff6bb0570-kube-api-access-85qhr\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.261858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-sys\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.261858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261864    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcx7l\" (UniqueName: \"kubernetes.io/projected/1be33a60-7830-41ed-a8c4-28c576309568-kube-api-access-vcx7l\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-bin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261955    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbnbr\" (UniqueName: \"kubernetes.io/projected/4b33cbaa-11aa-4d25-95bb-867618842766-kube-api-access-cbnbr\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.261978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq9gp\" (UniqueName: \"kubernetes.io/projected/94d63141-9177-4a26-be92-11125e1c5ab9-kube-api-access-wq9gp\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-slash\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-script-lib\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-host\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f366bf9e-fcd7-4526-8370-9398ca15d07f-tmp-dir\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.262218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-run\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-system-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262289    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262304    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-modprobe-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysconfig\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c962c0c-1334-4201-9a36-7e7bcc454f8d-agent-certs\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-bin\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-socket-dir-parent\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-multus\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cni-binary-copy\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-kubelet\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-conf\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262628    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-host\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-cnibin\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.262938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-systemd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-ovn\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-netd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262794    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-device-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-etc-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1be33a60-7830-41ed-a8c4-28c576309568-ovn-node-metrics-cert\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-k8s-cni-cncf-io\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xvpc\" (UniqueName: \"kubernetes.io/projected/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-kube-api-access-5xvpc\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c962c0c-1334-4201-9a36-7e7bcc454f8d-konnectivity-ca\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.262948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-kubelet-config\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-kubernetes\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-system-cni-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-systemd-units\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.263767 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-hostroot\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-daemon-config\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239b6026-1bc2-4a79-ba5f-561ff6bb0570-host-slash\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-node-log\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-config\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263250    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n64xl\" (UniqueName: \"kubernetes.io/projected/7c2b378d-932e-4e37-82f3-345110023994-kube-api-access-n64xl\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-dbus\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-var-lib-kubelet\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-kubelet\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239b6026-1bc2-4a79-ba5f-561ff6bb0570-iptables-alerter-script\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-lib-modules\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-tmp\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-log-socket\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.264569 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.263541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-netns\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.284263 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.284242    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:16:05.284369 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.284274    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:16:05.284369 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.284288    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:16:05.284369 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.284287    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:16:05.284369 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.284320    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:16:05.284507 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.284393    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kknvl\""
Oct 30 21:16:05.285128 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.285110    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:16:05.285314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.285299    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:16:05.285405 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.285391    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8g8v4\""
Oct 30 21:16:05.286207 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.286194    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:16:05.286264 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.286216    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:16:05.286264 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.286233    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:16:05.286354 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.286342    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hrcct\""
Oct 30 21:16:05.288704 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.288690    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:16:05.288803 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.288788    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:16:05.288803 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.288794    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:16:05.288905 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.288844    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333068    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-msgtv\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333138    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333152    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333161    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333227    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ks46b\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333234    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333231    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333160    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333262    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:05.333262 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333265    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:16:05.333667 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333274    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:16:05.333667 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333282    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:16:05.333667 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.333329    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:05.337512 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337493    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p6llv\""
Oct 30 21:16:05.337669 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337651    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fp6d9\""
Oct 30 21:16:05.337749 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337681    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:05.337749 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337687    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ztz2s\""
Oct 30 21:16:05.337749 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337748    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:16:05.337922 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337845    2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 30 21:16:05.337976 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337916    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5plwm"
Oct 30 21:16:05.337976 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.337954    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmnhg\""
Oct 30 21:16:05.364763 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-kubelet-config\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.364850 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-kubernetes\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.364850 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-system-cni-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.364850 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-systemd-units\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.364850 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-hostroot\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.364850 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-daemon-config\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239b6026-1bc2-4a79-ba5f-561ff6bb0570-host-slash\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-node-log\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364892    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-systemd-units\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364906    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-system-cni-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364892    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-kubelet-config\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364922    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-hostroot\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-config\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364933    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239b6026-1bc2-4a79-ba5f-561ff6bb0570-host-slash\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364944    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-kubernetes\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364958    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-node-log\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.364986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n64xl\" (UniqueName: \"kubernetes.io/projected/7c2b378d-932e-4e37-82f3-345110023994-kube-api-access-n64xl\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-dbus\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-var-lib-kubelet\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-kubelet\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239b6026-1bc2-4a79-ba5f-561ff6bb0570-iptables-alerter-script\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.365117 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365096    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-dbus\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365143    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-var-lib-kubelet\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365176    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-kubelet\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365292    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-lib-modules\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-tmp\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-log-socket\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-netns\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-multus-certs\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f366bf9e-fcd7-4526-8370-9398ca15d07f-hosts-file\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365437    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-log-socket\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-binary-copy\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365478    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-daemon-config\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365493    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-multus-certs\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365492    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-config\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365497    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-lib-modules\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365518    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-netns\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.365726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365525    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-var-lib-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365544    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f366bf9e-fcd7-4526-8370-9398ca15d07f-hosts-file\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-var-lib-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-env-overrides\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365683    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg9g\" (UniqueName: \"kubernetes.io/projected/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-kube-api-access-8jg9g\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-etc-tuned\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365745    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239b6026-1bc2-4a79-ba5f-561ff6bb0570-iptables-alerter-script\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365736    2581 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-serviceca\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-etc-kubernetes\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7tmq\" (UniqueName: \"kubernetes.io/projected/f366bf9e-fcd7-4526-8370-9398ca15d07f-kube-api-access-n7tmq\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.365844    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-systemd\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.365955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-netns\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.366498 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.365984    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret podName:26f80d0e-54bd-400f-9b86-7103ea34895a nodeName:}" failed. No retries permitted until 2026-10-30 21:16:05.865962643 +0000 UTC m=+2.297703894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret") pod "global-pull-secret-syncer-2g9kx" (UID: "26f80d0e-54bd-400f-9b86-7103ea34895a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366001    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-netns\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366038    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-binary-copy\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cnibin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366049    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-etc-kubernetes\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cnibin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366114    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-env-overrides\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-conf-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366239    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-systemd\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2h6f\" (UniqueName: \"kubernetes.io/projected/725fdb19-6f8c-406e-b4c4-f9b2597887ba-kube-api-access-b2h6f\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366277    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-conf-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85qhr\" (UniqueName: \"kubernetes.io/projected/239b6026-1bc2-4a79-ba5f-561ff6bb0570-kube-api-access-85qhr\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366361    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-serviceca\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-sys\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366572    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-sys\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.367358 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366609    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcx7l\" (UniqueName: \"kubernetes.io/projected/1be33a60-7830-41ed-a8c4-28c576309568-kube-api-access-vcx7l\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366722    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-bin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366770    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbnbr\" (UniqueName: \"kubernetes.io/projected/4b33cbaa-11aa-4d25-95bb-867618842766-kube-api-access-cbnbr\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366813    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366829    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-bin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9gp\" (UniqueName: \"kubernetes.io/projected/94d63141-9177-4a26-be92-11125e1c5ab9-kube-api-access-wq9gp\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-slash\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-script-lib\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366946    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366951    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.366904    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366990    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.368314 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-slash\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.366993    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-host\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f366bf9e-fcd7-4526-8370-9398ca15d07f-tmp-dir\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.367039    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:05.867021084 +0000 UTC m=+2.298762329 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-run\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367081    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367036    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-host\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-system-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-modprobe-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysconfig\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367216    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-run\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367221    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367263    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367270    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f366bf9e-fcd7-4526-8370-9398ca15d07f-tmp-dir\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367285    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369199 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367318    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-system-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c962c0c-1334-4201-9a36-7e7bcc454f8d-agent-certs\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367368    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysconfig\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367368    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-modprobe-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-bin\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367493    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-script-lib\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-socket-dir-parent\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367505    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-bin\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-multus\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cni-binary-copy\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367571    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-socket-dir-parent\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-kubelet\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367606    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-multus\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-conf\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-host\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-kubelet\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-cnibin\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-cnibin\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.369934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367723    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-host\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367752    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-conf\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-systemd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-ovn\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-netd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-device-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367886    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-ovn\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-etc-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367929    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1be33a60-7830-41ed-a8c4-28c576309568-ovn-node-metrics-cert\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-k8s-cni-cncf-io\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xvpc\" (UniqueName: \"kubernetes.io/projected/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-kube-api-access-5xvpc\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c962c0c-1334-4201-9a36-7e7bcc454f8d-konnectivity-ca\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368100    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cni-binary-copy\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.370448 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368175    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368231    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.367836    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-systemd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368297    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-netd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368351    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-device-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368348    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-k8s-cni-cncf-io\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368390    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-etc-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.368610    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c962c0c-1334-4201-9a36-7e7bcc454f8d-konnectivity-ca\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.369684    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-etc-tuned\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.369786    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-tmp\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.370220    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c962c0c-1334-4201-9a36-7e7bcc454f8d-agent-certs\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.370980 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.370365    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1be33a60-7830-41ed-a8c4-28c576309568-ovn-node-metrics-cert\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.425856 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.425828    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:16:05.425976 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.425860    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:16:05.425976 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.425873    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5bsjm for pod openshift-network-diagnostics/network-check-target-cmvnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:05.425976 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.425936    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm podName:00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:05.925915658 +0000 UTC m=+2.357656904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5bsjm" (UniqueName: "kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm") pod "network-check-target-cmvnx" (UID: "00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:05.426535 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.426506    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n64xl\" (UniqueName: \"kubernetes.io/projected/7c2b378d-932e-4e37-82f3-345110023994-kube-api-access-n64xl\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.426844 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.426817    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg9g\" (UniqueName: \"kubernetes.io/projected/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-kube-api-access-8jg9g\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:05.427934 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.427913    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qhr\" (UniqueName: \"kubernetes.io/projected/239b6026-1bc2-4a79-ba5f-561ff6bb0570-kube-api-access-85qhr\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.428085 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.428063    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbnbr\" (UniqueName: \"kubernetes.io/projected/4b33cbaa-11aa-4d25-95bb-867618842766-kube-api-access-cbnbr\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.428085 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.428076    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2h6f\" (UniqueName: \"kubernetes.io/projected/725fdb19-6f8c-406e-b4c4-f9b2597887ba-kube-api-access-b2h6f\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.428401 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.428382    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7tmq\" (UniqueName: \"kubernetes.io/projected/f366bf9e-fcd7-4526-8370-9398ca15d07f-kube-api-access-n7tmq\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.429062 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.429039    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xvpc\" (UniqueName: \"kubernetes.io/projected/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-kube-api-access-5xvpc\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.429159 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.429113    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcx7l\" (UniqueName: \"kubernetes.io/projected/1be33a60-7830-41ed-a8c4-28c576309568-kube-api-access-vcx7l\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.430676 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.430658    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9gp\" (UniqueName: \"kubernetes.io/projected/94d63141-9177-4a26-be92-11125e1c5ab9-kube-api-access-wq9gp\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.554722 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.554654    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:05.564892 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.564864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:05.582745 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.582726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:05.604391 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.604366    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-44tnc"
Oct 30 21:16:05.604581 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.604426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:05.618862 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.618831    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:05.626015 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.625993    2581 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:05.634528 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.634508    2581 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:05.636793 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.636777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:05.641470 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.641456    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:05.659375 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.659342    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:05.710073 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:05.710042    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a83213484fa2827d610c578ff6f296.slice/crio-d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5 WatchSource:0}: Error finding container d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5: Status 404 returned error can't find the container with id d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5
Oct 30 21:16:05.710497 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:05.710482    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f5ce0999b1672653e8437773a46c25.slice/crio-77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0 WatchSource:0}: Error finding container 77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0: Status 404 returned error can't find the container with id 77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0
Oct 30 21:16:05.717054 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.717034    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:16:05.759428 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.759402    2581 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:05.872872 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.872802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:05.872872 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.872840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:05.873022 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.872963    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:05.873022 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.873019    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret podName:26f80d0e-54bd-400f-9b86-7103ea34895a nodeName:}" failed. No retries permitted until 2026-10-30 21:16:06.873005449 +0000 UTC m=+3.304746693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret") pod "global-pull-secret-syncer-2g9kx" (UID: "26f80d0e-54bd-400f-9b86-7103ea34895a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:05.873095 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.872963    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:05.873095 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.873056    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:06.873045938 +0000 UTC m=+3.304787183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:05.973920 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:05.973889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:05.974421 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.974011    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:16:05.974421 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.974028    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:16:05.974421 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.974038    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5bsjm for pod openshift-network-diagnostics/network-check-target-cmvnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:05.974421 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:05.974088    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm podName:00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:06.974071616 +0000 UTC m=+3.405812849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bsjm" (UniqueName: "kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm") pod "network-check-target-cmvnx" (UID: "00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:06.024909 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:06.024862    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"a1f5ce0999b1672653e8437773a46c25","Type":"ContainerStarted","Data":"77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0"}
Oct 30 21:16:06.026029 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:06.026008    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"61a83213484fa2827d610c578ff6f296","Type":"ContainerStarted","Data":"d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5"}
Oct 30 21:16:06.340528 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:06.340422    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:11:05 +0000 UTC" deadline="2028-06-14 21:57:37.491756623 +0000 UTC"
Oct 30 21:16:06.340528 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:06.340473    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14232h41m31.151286582s"
Oct 30 21:16:06.415785 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.415753    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d63141_9177_4a26_be92_11125e1c5ab9.slice/crio-b2a7b5e2465c5043635c11dcdf1ae07911d082e7d0683da8df5891ff98b46608 WatchSource:0}: Error finding container b2a7b5e2465c5043635c11dcdf1ae07911d082e7d0683da8df5891ff98b46608: Status 404 returned error can't find the container with id b2a7b5e2465c5043635c11dcdf1ae07911d082e7d0683da8df5891ff98b46608
Oct 30 21:16:06.506304 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.506255    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be33a60_7830_41ed_a8c4_28c576309568.slice/crio-9a643b5224b2daaf969b6f4a3b0ee744ddeda6d379ebecef6ceabc4424cd8b0c WatchSource:0}: Error finding container 9a643b5224b2daaf969b6f4a3b0ee744ddeda6d379ebecef6ceabc4424cd8b0c: Status 404 returned error can't find the container with id 9a643b5224b2daaf969b6f4a3b0ee744ddeda6d379ebecef6ceabc4424cd8b0c
Oct 30 21:16:06.507195 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.507171    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c2b378d_932e_4e37_82f3_345110023994.slice/crio-3241f2fe1505e9d0325ea84c7b65817234b6245596b0cb5020bd4359ed2e5aef WatchSource:0}: Error finding container 3241f2fe1505e9d0325ea84c7b65817234b6245596b0cb5020bd4359ed2e5aef: Status 404 returned error can't find the container with id 3241f2fe1505e9d0325ea84c7b65817234b6245596b0cb5020bd4359ed2e5aef
Oct 30 21:16:06.545889 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.545858    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725fdb19_6f8c_406e_b4c4_f9b2597887ba.slice/crio-33819f234d5b55176affe85ef9401d6a97e21cee893207e43c592eb329e3bf23 WatchSource:0}: Error finding container 33819f234d5b55176affe85ef9401d6a97e21cee893207e43c592eb329e3bf23: Status 404 returned error can't find the container with id 33819f234d5b55176affe85ef9401d6a97e21cee893207e43c592eb329e3bf23
Oct 30 21:16:06.546607 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.546574    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ef1df8_7bdf_42c3_9934_ba7929ffa72d.slice/crio-20dfa61b24f7e9b76ea64b8fb187e9474b5ff39fb8732a40bb87e48b86561ebe WatchSource:0}: Error finding container 20dfa61b24f7e9b76ea64b8fb187e9474b5ff39fb8732a40bb87e48b86561ebe: Status 404 returned error can't find the container with id 20dfa61b24f7e9b76ea64b8fb187e9474b5ff39fb8732a40bb87e48b86561ebe
Oct 30 21:16:06.586896 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.586876    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239b6026_1bc2_4a79_ba5f_561ff6bb0570.slice/crio-b104c28565fdf124bbdb9ddfefa1308396014530a94f96f8a61b76c55d2fe5b0 WatchSource:0}: Error finding container b104c28565fdf124bbdb9ddfefa1308396014530a94f96f8a61b76c55d2fe5b0: Status 404 returned error can't find the container with id b104c28565fdf124bbdb9ddfefa1308396014530a94f96f8a61b76c55d2fe5b0
Oct 30 21:16:06.609106 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.609084    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b33cbaa_11aa_4d25_95bb_867618842766.slice/crio-d91217bf34862b297c389863a44028a6520185b7481f63d6dac97131bc74324c WatchSource:0}: Error finding container d91217bf34862b297c389863a44028a6520185b7481f63d6dac97131bc74324c: Status 404 returned error can't find the container with id d91217bf34862b297c389863a44028a6520185b7481f63d6dac97131bc74324c
Oct 30 21:16:06.632902 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.632875    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c962c0c_1334_4201_9a36_7e7bcc454f8d.slice/crio-f5a11661ea88cae2f87756759f6934bc89e8cf7b77b9a53e2e50a8e354b6c9aa WatchSource:0}: Error finding container f5a11661ea88cae2f87756759f6934bc89e8cf7b77b9a53e2e50a8e354b6c9aa: Status 404 returned error can't find the container with id f5a11661ea88cae2f87756759f6934bc89e8cf7b77b9a53e2e50a8e354b6c9aa
Oct 30 21:16:06.650076 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:06.650046    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf366bf9e_fcd7_4526_8370_9398ca15d07f.slice/crio-68e423f5f2ce32b6d539fb5d584f3a74b24392e74ba7953182e3533ef80856bd WatchSource:0}: Error finding container 68e423f5f2ce32b6d539fb5d584f3a74b24392e74ba7953182e3533ef80856bd: Status 404 returned error can't find the container with id 68e423f5f2ce32b6d539fb5d584f3a74b24392e74ba7953182e3533ef80856bd
Oct 30 21:16:06.882251 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:06.882166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:06.882423 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:06.882268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:06.882423 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.882338    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:06.882423 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.882391    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:06.882423 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.882416    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:08.88239309 +0000 UTC m=+5.314134336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:06.882683 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.882446    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret podName:26f80d0e-54bd-400f-9b86-7103ea34895a nodeName:}" failed. No retries permitted until 2026-10-30 21:16:08.882431627 +0000 UTC m=+5.314172872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret") pod "global-pull-secret-syncer-2g9kx" (UID: "26f80d0e-54bd-400f-9b86-7103ea34895a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:06.983320 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:06.983285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:06.983907 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.983433    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:16:06.983907 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.983448    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:16:06.983907 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.983460    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5bsjm for pod openshift-network-diagnostics/network-check-target-cmvnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:06.983907 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:06.983507    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm podName:00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:08.983494353 +0000 UTC m=+5.415235583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bsjm" (UniqueName: "kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm") pod "network-check-target-cmvnx" (UID: "00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:07.018634 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.018606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:07.018825 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.018754    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:07.018825 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:07.018759    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:07.018950 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:07.018875    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:07.018950 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.018901    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:07.019101 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:07.019009    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:07.029118 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.029089    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlvrt" event={"ID":"f366bf9e-fcd7-4526-8370-9398ca15d07f","Type":"ContainerStarted","Data":"68e423f5f2ce32b6d539fb5d584f3a74b24392e74ba7953182e3533ef80856bd"}
Oct 30 21:16:07.030636 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.030593    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4l6nm" event={"ID":"4b33cbaa-11aa-4d25-95bb-867618842766","Type":"ContainerStarted","Data":"d91217bf34862b297c389863a44028a6520185b7481f63d6dac97131bc74324c"}
Oct 30 21:16:07.032250 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.032214    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jmrh" event={"ID":"239b6026-1bc2-4a79-ba5f-561ff6bb0570","Type":"ContainerStarted","Data":"b104c28565fdf124bbdb9ddfefa1308396014530a94f96f8a61b76c55d2fe5b0"}
Oct 30 21:16:07.033886 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.033789    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"9a643b5224b2daaf969b6f4a3b0ee744ddeda6d379ebecef6ceabc4424cd8b0c"}
Oct 30 21:16:07.040463 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.040433    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pzlh" event={"ID":"5c962c0c-1334-4201-9a36-7e7bcc454f8d","Type":"ContainerStarted","Data":"f5a11661ea88cae2f87756759f6934bc89e8cf7b77b9a53e2e50a8e354b6c9aa"}
Oct 30 21:16:07.042115 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.042087    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-44tnc" event={"ID":"725fdb19-6f8c-406e-b4c4-f9b2597887ba","Type":"ContainerStarted","Data":"33819f234d5b55176affe85ef9401d6a97e21cee893207e43c592eb329e3bf23"}
Oct 30 21:16:07.043726 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.043698    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z92xh" event={"ID":"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d","Type":"ContainerStarted","Data":"20dfa61b24f7e9b76ea64b8fb187e9474b5ff39fb8732a40bb87e48b86561ebe"}
Oct 30 21:16:07.045152 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.045127    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx" event={"ID":"7c2b378d-932e-4e37-82f3-345110023994","Type":"ContainerStarted","Data":"3241f2fe1505e9d0325ea84c7b65817234b6245596b0cb5020bd4359ed2e5aef"}
Oct 30 21:16:07.046381 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.046358    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerStarted","Data":"b2a7b5e2465c5043635c11dcdf1ae07911d082e7d0683da8df5891ff98b46608"}
Oct 30 21:16:07.341101 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.340822    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:11:05 +0000 UTC" deadline="2028-05-06 07:22:32.28723206 +0000 UTC"
Oct 30 21:16:07.341101 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:07.340883    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13282h6m24.946352923s"
Oct 30 21:16:08.899398 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:08.899364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:08.900019 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:08.899425    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:08.900019 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:08.899568    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:08.900019 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:08.899718    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:08.900019 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:08.899787    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret podName:26f80d0e-54bd-400f-9b86-7103ea34895a nodeName:}" failed. No retries permitted until 2026-10-30 21:16:12.899765896 +0000 UTC m=+9.331507147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret") pod "global-pull-secret-syncer-2g9kx" (UID: "26f80d0e-54bd-400f-9b86-7103ea34895a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:08.900019 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:08.899905    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:12.89987942 +0000 UTC m=+9.331620664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:08.999876 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:08.999826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:09.000107 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:09.000086    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:16:09.000181 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:09.000118    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:16:09.000181 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:09.000132    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5bsjm for pod openshift-network-diagnostics/network-check-target-cmvnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:09.000296 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:09.000194    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm podName:00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:13.000174642 +0000 UTC m=+9.431915900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bsjm" (UniqueName: "kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm") pod "network-check-target-cmvnx" (UID: "00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:09.019951 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:09.019458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:09.019951 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:09.019617    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:09.019951 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:09.019703    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:09.019951 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:09.019796    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:09.019951 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:09.019847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:09.019951 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:09.019914    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:10.084509 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:10.084322    2581 generic.go:356] "Generic (PLEG): container finished" podID="a1f5ce0999b1672653e8437773a46c25" containerID="b571a0ecc59156413a6ea672907414012a8ee127d9816c602aa1b46dadb2ae42" exitCode=0
Oct 30 21:16:10.084978 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:10.084555    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"a1f5ce0999b1672653e8437773a46c25","Type":"ContainerDied","Data":"b571a0ecc59156413a6ea672907414012a8ee127d9816c602aa1b46dadb2ae42"}
Oct 30 21:16:10.102735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:10.102271    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"61a83213484fa2827d610c578ff6f296","Type":"ContainerStarted","Data":"478fe7bf70fa7c91749ecdd5ec0b57fc9ae6b76eacd907238309a579c6f3576b"}
Oct 30 21:16:11.018606 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:11.018557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:11.018831 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:11.018798    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:11.018936 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:11.018875    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:11.019001 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:11.018954    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:11.019064 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:11.019020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:11.019120 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:11.019104    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:11.125082 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:11.125034    2581 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="c00cce93cde2ac01b0a910f4790ce980636bd1fe1f06045fd5a34d4e38b80ac3" exitCode=0
Oct 30 21:16:11.125669 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:11.125168    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerDied","Data":"c00cce93cde2ac01b0a910f4790ce980636bd1fe1f06045fd5a34d4e38b80ac3"}
Oct 30 21:16:11.141825 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:11.141789    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"a1f5ce0999b1672653e8437773a46c25","Type":"ContainerStarted","Data":"70577b3a4fb424bcfa807badab3b07a809bd09364c20412224af40d472aae5bc"}
Oct 30 21:16:11.364108 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:11.363977    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal" podStartSLOduration=6.363956669 podStartE2EDuration="6.363956669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:10.33007825 +0000 UTC m=+6.761819505" watchObservedRunningTime="2026-10-30 21:16:11.363956669 +0000 UTC m=+7.795697925"
Oct 30 21:16:12.155138 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:12.153408    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6pzlh" event={"ID":"5c962c0c-1334-4201-9a36-7e7bcc454f8d","Type":"ContainerStarted","Data":"aab696188c3ddebe9801fe378d1548964705d8b442a12882b95b33e7662b1018"}
Oct 30 21:16:12.167186 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:12.167159    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:12.167683 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:12.167646    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:12.275653 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:12.275531    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal" podStartSLOduration=7.275509615 podStartE2EDuration="7.275509615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:11.431208691 +0000 UTC m=+7.862949948" watchObservedRunningTime="2026-10-30 21:16:12.275509615 +0000 UTC m=+8.707250869"
Oct 30 21:16:12.400163 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:12.398871    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6pzlh" podStartSLOduration=2.615458295 podStartE2EDuration="7.398850816s" totalImagesPullingTime="4.783392521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:12.276262791 +0000 UTC m=+8.708004046" watchObservedRunningTime="2026-10-30 21:16:12.398850816 +0000 UTC m=+8.830592071"
Oct 30 21:16:12.933213 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:12.932782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:12.933213 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:12.932882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:12.933213 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:12.933022    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:12.933213 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:12.933081    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret podName:26f80d0e-54bd-400f-9b86-7103ea34895a nodeName:}" failed. No retries permitted until 2026-10-30 21:16:20.933063805 +0000 UTC m=+17.364805055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret") pod "global-pull-secret-syncer-2g9kx" (UID: "26f80d0e-54bd-400f-9b86-7103ea34895a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:12.933213 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:12.933151    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:12.933213 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:12.933187    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:20.933174951 +0000 UTC m=+17.364916190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:13.019294 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:13.018785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:13.019294 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:13.018917    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:13.019294 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:13.019014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:13.019294 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:13.019101    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:13.019294 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:13.019174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:13.019294 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:13.019247    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:13.034084 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:13.033807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:13.034084 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:13.033966    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:16:13.034084 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:13.033983    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:16:13.034084 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:13.033997    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5bsjm for pod openshift-network-diagnostics/network-check-target-cmvnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:13.034084 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:13.034047    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm podName:00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:21.034030897 +0000 UTC m=+17.465772130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bsjm" (UniqueName: "kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm") pod "network-check-target-cmvnx" (UID: "00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:13.159722 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:13.159618    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z92xh" event={"ID":"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d","Type":"ContainerStarted","Data":"62e895ddb3fc7791e0a9efb5ab899b66c5420dbd7f49e2a7f59ebd9e679e4ecd"}
Oct 30 21:16:14.163474 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:14.163440    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx" event={"ID":"7c2b378d-932e-4e37-82f3-345110023994","Type":"ContainerStarted","Data":"c93b0d32f885c9dc4a393c79584526f82ae643ea255451965e4cd02c1c049455"}
Oct 30 21:16:14.164110 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:14.163577    2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:16:15.019582 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:15.019544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:15.019728 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:15.019659    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:15.019728 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:15.019711    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:15.019835 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:15.019751    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:15.019835 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:15.019784    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:15.019835 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:15.019833    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:15.167422 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:15.167329    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-44tnc" event={"ID":"725fdb19-6f8c-406e-b4c4-f9b2597887ba","Type":"ContainerStarted","Data":"1f2f27e976a0dfb42010c937aa5fce272b42aba7ac5cbf3eaece9f37bc72224d"}
Oct 30 21:16:15.284088 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:15.284040    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z92xh" podStartSLOduration=4.40106712 podStartE2EDuration="10.284027557s" totalImagesPullingTime="5.882960437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:13.281659737 +0000 UTC m=+9.713400992" watchObservedRunningTime="2026-10-30 21:16:15.284027557 +0000 UTC m=+11.715768809"
Oct 30 21:16:15.610971 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:15.610947    2581 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:16:16.014742 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.014634    2581 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:16:15.610968104Z","UUID":"069868f1-ab34-4146-b6a1-f569a68fc73d","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:16:16.016255 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.016224    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:16:16.016255 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.016252    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:16:16.171719 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.171681    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx" event={"ID":"7c2b378d-932e-4e37-82f3-345110023994","Type":"ContainerStarted","Data":"943ec4aab4d7dc3495441e9afbaf2774f109fd07df24b82651a3ad03ab207387"}
Oct 30 21:16:16.173937 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.173909    2581 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="c3a4899ba466aa8592f25be93e85f29bfdd8b63943c3d57c6ca685dae5512a61" exitCode=0
Oct 30 21:16:16.174074 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.174000    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerDied","Data":"c3a4899ba466aa8592f25be93e85f29bfdd8b63943c3d57c6ca685dae5512a61"}
Oct 30 21:16:16.176445 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.176324    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlvrt" event={"ID":"f366bf9e-fcd7-4526-8370-9398ca15d07f","Type":"ContainerStarted","Data":"9a83ebea4cd02807f0990a286d80b9f57f04a53ec5a416a6cce3de3c55ab012a"}
Oct 30 21:16:16.293201 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.293130    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-44tnc" podStartSLOduration=2.921844128 podStartE2EDuration="11.293112061s" totalImagesPullingTime="8.371267933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:15.28473698 +0000 UTC m=+11.716478233" watchObservedRunningTime="2026-10-30 21:16:16.293112061 +0000 UTC m=+12.724853330"
Oct 30 21:16:16.406177 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:16.406116    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-hlvrt" podStartSLOduration=2.235729499 podStartE2EDuration="11.40609108s" totalImagesPullingTime="9.170361581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:16.406043009 +0000 UTC m=+12.837784260" watchObservedRunningTime="2026-10-30 21:16:16.40609108 +0000 UTC m=+12.837832331"
Oct 30 21:16:17.018995 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:17.018766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:17.019142 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:17.018994    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:17.019142 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:17.019082    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:17.019208 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:17.019156    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:17.019240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:17.019212    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:17.019319 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:17.019291    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:17.181976 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:17.181930    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx" event={"ID":"7c2b378d-932e-4e37-82f3-345110023994","Type":"ContainerStarted","Data":"8d117d1a79687837ce8813e184f6d764654974194ead47f37eac9768260c8b47"}
Oct 30 21:16:17.183938 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:17.183875    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jmrh" event={"ID":"239b6026-1bc2-4a79-ba5f-561ff6bb0570","Type":"ContainerStarted","Data":"80284f4800093966f1d9346f7469efba75eba89dfadc19300fcf8e044d79f4a2"}
Oct 30 21:16:17.298586 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:17.298107    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx" podStartSLOduration=2.181704102 podStartE2EDuration="12.298083945s" totalImagesPullingTime="10.116379843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:17.297579753 +0000 UTC m=+13.729321003" watchObservedRunningTime="2026-10-30 21:16:17.298083945 +0000 UTC m=+13.729825195"
Oct 30 21:16:18.188452 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:18.188421    2581 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="0064f0592b2f7a84793cf3e2a34966fc3546b840cab8c3dfaf46a3f37c91bea4" exitCode=0
Oct 30 21:16:18.189049 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:18.188514    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerDied","Data":"0064f0592b2f7a84793cf3e2a34966fc3546b840cab8c3dfaf46a3f37c91bea4"}
Oct 30 21:16:18.190211 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:18.190147    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4l6nm" event={"ID":"4b33cbaa-11aa-4d25-95bb-867618842766","Type":"ContainerStarted","Data":"fc1c3de9044002c2e640efd5f749d32dc09aa289e18f9da96a168250c755fe32"}
Oct 30 21:16:18.303247 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:18.303195    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7jmrh" podStartSLOduration=4.37088308 podStartE2EDuration="13.30318268s" totalImagesPullingTime="8.9322996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:17.412707919 +0000 UTC m=+13.844449170" watchObservedRunningTime="2026-10-30 21:16:18.30318268 +0000 UTC m=+14.734923929"
Oct 30 21:16:18.415959 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:18.415903    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4l6nm" podStartSLOduration=2.36262942 podStartE2EDuration="13.415887078s" totalImagesPullingTime="11.053257658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:18.415307376 +0000 UTC m=+14.847048626" watchObservedRunningTime="2026-10-30 21:16:18.415887078 +0000 UTC m=+14.847628368"
Oct 30 21:16:19.018931 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:19.018898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:19.018931 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:19.018932    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:19.019171 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:19.018940    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:19.019171 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:19.019011    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:19.019171 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:19.019094    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:19.019295 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:19.019199    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:20.197256 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:20.197214    2581 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="977a3bc81eb8e1a63cddb17ad65df4b36f265dfe88bd2d320f3531ac0b18271e" exitCode=0
Oct 30 21:16:20.197952 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:20.197267    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerDied","Data":"977a3bc81eb8e1a63cddb17ad65df4b36f265dfe88bd2d320f3531ac0b18271e"}
Oct 30 21:16:20.997142 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:20.997113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:20.997342 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:20.997195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:20.997342 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:20.997244    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:20.997342 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:20.997274    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:20.997342 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:20.997309    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.99729175 +0000 UTC m=+33.429032996 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 30 21:16:20.997342 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:20.997326    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret podName:26f80d0e-54bd-400f-9b86-7103ea34895a nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.997319692 +0000 UTC m=+33.429060919 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret") pod "global-pull-secret-syncer-2g9kx" (UID: "26f80d0e-54bd-400f-9b86-7103ea34895a") : object "kube-system"/"original-pull-secret" not registered
Oct 30 21:16:21.019401 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:21.019367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:21.019545 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:21.019387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:21.019545 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:21.019471    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:21.019670 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:21.019528    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:21.019670 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:21.019589    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:21.019670 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:21.019626    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:21.098186 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:21.098146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:21.098344 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:21.098288    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 30 21:16:21.098344 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:21.098306    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 30 21:16:21.098344 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:21.098314    2581 projected.go:196] Error preparing data for projected volume kube-api-access-5bsjm for pod openshift-network-diagnostics/network-check-target-cmvnx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:21.098508 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:21.098365    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm podName:00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:37.098352393 +0000 UTC m=+33.530093648 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5bsjm" (UniqueName: "kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm") pod "network-check-target-cmvnx" (UID: "00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 30 21:16:22.206439 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:22.206257    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"aff23ead1b2a8748e30d75e75d0e1aeae95baf7ebdc9ba766947ee9221aded69"}
Oct 30 21:16:22.206948 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:22.206491    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"6992c6a10a9a36215a7250be4c848bdf4a2bf336c89145224495eadd6940b7b8"}
Oct 30 21:16:22.206948 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:22.206543    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"643004e0f72fbd3d0626ecd96a449b9f932bae0f27fbf9195113541fb07ac8cd"}
Oct 30 21:16:22.206948 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:22.206606    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"a731477314f01029f1f9c7034be877896be99754e741078d48740ab119b287cd"}
Oct 30 21:16:22.206948 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:22.206656    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"47a4ffb4230539184d6fe2095d6431d52e31f60200fd3d4bcc6913f6fe095cb5"}
Oct 30 21:16:22.206948 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:22.206697    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"680ef3535f91351af08a6f8c7837ab0133747656491313ffba55530c27b545c6"}
Oct 30 21:16:23.018873 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:23.018762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:23.018873 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:23.018833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:23.019035 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:23.018918    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:23.019035 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:23.018928    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:23.019035 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:23.019009    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:23.019133 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:23.019073    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:23.210805 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:23.210771    2581 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="86eafbbc8811f7941b4a996d08cd533af81883f21a6242142ed3eee6af52c7cc" exitCode=0
Oct 30 21:16:23.211163 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:23.210826    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerDied","Data":"86eafbbc8811f7941b4a996d08cd533af81883f21a6242142ed3eee6af52c7cc"}
Oct 30 21:16:24.216127 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:24.216090    2581 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="5175ef9dde143eeca9b191ea3c97f46aa9187620bcf5810dfa023db5e7be6ec1" exitCode=0
Oct 30 21:16:24.216701 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:24.216170    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerDied","Data":"5175ef9dde143eeca9b191ea3c97f46aa9187620bcf5810dfa023db5e7be6ec1"}
Oct 30 21:16:24.219400 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:24.219377    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"99b5aba3cc93380550fecd79825b8b8506ac93c65f9613ca78923e4ec5f96636"}
Oct 30 21:16:24.664888 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:24.664867    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:24.665047 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:24.664970    2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:16:24.665354 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:24.665340    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:25.019099 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:25.019028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:25.019099 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:25.019057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:25.019295 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:25.019031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:25.019295 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:25.019149    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:25.019295 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:25.019209    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:25.019295 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:25.019281    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:25.224991 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:25.224954    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-blmqq" event={"ID":"94d63141-9177-4a26-be92-11125e1c5ab9","Type":"ContainerStarted","Data":"4bbc60caef82e66db32146bd55a75ff00903253203e0df066bcc289bfdaba106"}
Oct 30 21:16:25.341106 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:25.341026    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-blmqq" podStartSLOduration=7.107042178 podStartE2EDuration="20.34101306s" totalImagesPullingTime="13.233970882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:25.340634215 +0000 UTC m=+21.772375530" watchObservedRunningTime="2026-10-30 21:16:25.34101306 +0000 UTC m=+21.772754310"
Oct 30 21:16:26.231257 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:26.231024    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" event={"ID":"1be33a60-7830-41ed-a8c4-28c576309568","Type":"ContainerStarted","Data":"8fead87a7ed39a8aa14cde3dfb979e6491ed97a279414689fb7e732ba358eb86"}
Oct 30 21:16:26.499865 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:26.499783    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7" podStartSLOduration=6.621797022 podStartE2EDuration="21.499770585s" totalImagesPullingTime="14.877973563s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:26.499332308 +0000 UTC m=+22.931073570" watchObservedRunningTime="2026-10-30 21:16:26.499770585 +0000 UTC m=+22.931511835"
Oct 30 21:16:27.019517 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.019490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:27.019517 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.019503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:27.019706 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.019588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:27.019706 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:27.019602    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:27.019706 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:27.019653    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:27.019795 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:27.019713    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:27.236403 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.236373    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:27.244624 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.244605    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:27.244849 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.244838    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:27.266379 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.266354    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:27.268717 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:27.268695    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:28.772855 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:28.772822    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmvnx"]
Oct 30 21:16:28.773382 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:28.772941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:28.773382 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:28.773023    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:28.773620 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:28.773600    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2g9kx"]
Oct 30 21:16:28.773729 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:28.773706    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:28.773831 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:28.773795    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:28.774764 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:28.774740    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hstlp"]
Oct 30 21:16:28.774855 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:28.774843    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:28.774947 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:28.774931    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:31.018939 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:31.018868    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:31.019379 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:31.018964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:31.019379 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:31.018968    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:31.019379 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:31.019040    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:31.019379 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:31.019068    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:31.019379 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:31.019209    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:33.018904 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:33.018871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:33.018904 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:33.018907    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:33.019369 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:33.018961    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:33.019369 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:33.018971    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hstlp" podUID="8947b771-89ac-46dc-9f8c-f218bdfaa7f5"
Oct 30 21:16:33.019369 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:33.019058    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2g9kx" podUID="26f80d0e-54bd-400f-9b86-7103ea34895a"
Oct 30 21:16:33.019369 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:33.019145    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cmvnx" podUID="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68"
Oct 30 21:16:34.859845 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:34.859817    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:16:34.860203 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:34.859922    2581 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 30 21:16:34.972747 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:34.972720    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vmw5p"]
Oct 30 21:16:34.974681 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:34.974665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-vmw5p"
Oct 30 21:16:35.011436 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.011405    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-spg6c"]
Oct 30 21:16:35.012811 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.012794    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mdw62"]
Oct 30 21:16:35.012919 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.012902    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-spg6c"
Oct 30 21:16:35.014439 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.014410    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mdw62"
Oct 30 21:16:35.019137 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.018513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:35.019137 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.018533    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:35.019769 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.018541    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:35.022585 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.022275    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-d7kds"]
Oct 30 21:16:35.030068 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.030049    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-stjmx"]
Oct 30 21:16:35.030186 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.030171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.032182 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.032161    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-675c47d4b7-tznvs"]
Oct 30 21:16:35.032305 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.032290    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:35.034542 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.034527    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"]
Oct 30 21:16:35.034655 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.034636    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.036057 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.036035    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d7bfbd7bc-slk74"]
Oct 30 21:16:35.036134 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.036117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.037699 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.037685    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"]
Oct 30 21:16:35.037813 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.037797    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.039306 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.039290    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"]
Oct 30 21:16:35.039437 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.039417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.040888 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.040871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.061518 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.061361    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"]
Oct 30 21:16:35.063598 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.063581    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c9745cfc4-b9rb6"]
Oct 30 21:16:35.063705 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.063645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.065711 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.065679    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"]
Oct 30 21:16:35.066120 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.066103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.067178 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.067164    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"]
Oct 30 21:16:35.067296 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.067279    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.071470 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.071245    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.071842 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.071525    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.072126 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.072108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"
Oct 30 21:16:35.075162 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.075139    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"]
Oct 30 21:16:35.077809 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.077792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"
Oct 30 21:16:35.077947 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.077932    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7zdht"]
Oct 30 21:16:35.080831 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.080812    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kwbfv"]
Oct 30 21:16:35.080928 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.080898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.082656 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.082639    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vmw5p"]
Oct 30 21:16:35.082754 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.082671    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-spg6c"]
Oct 30 21:16:35.082754 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.082691    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mdw62"]
Oct 30 21:16:35.082754 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.082710    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-d7kds"]
Oct 30 21:16:35.082754 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.082731    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-675c47d4b7-tznvs"]
Oct 30 21:16:35.082949 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.082804    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.083375 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.083356    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"]
Oct 30 21:16:35.084003 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.083986    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"]
Oct 30 21:16:35.085265 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.085243    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"]
Oct 30 21:16:35.085851 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.085833    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9745cfc4-b9rb6"]
Oct 30 21:16:35.086788 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.086768    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"]
Oct 30 21:16:35.100788 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.100766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-tmp\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.100916 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.100804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a1d8929-5e86-41ec-9298-26531344f8ee-nginx-conf\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:35.100989 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.100935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7g6j\" (UniqueName: \"kubernetes.io/projected/b9bc359e-dff6-4151-9210-553cb6cb727f-kube-api-access-b7g6j\") pod \"kas-connection-checker-685895c7c9-spg6c\" (UID: \"b9bc359e-dff6-4151-9210-553cb6cb727f\") " pod="kube-system/kas-connection-checker-685895c7c9-spg6c"
Oct 30 21:16:35.100989 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.100962    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5b77\" (UniqueName: \"kubernetes.io/projected/f6248f5b-93ea-43c6-8a91-ab757ba777fa-kube-api-access-q5b77\") pod \"kas-connection-checker-685895c7c9-mdw62\" (UID: \"f6248f5b-93ea-43c6-8a91-ab757ba777fa\") " pod="kube-system/kas-connection-checker-685895c7c9-mdw62"
Oct 30 21:16:35.100989 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.100978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-snapshots\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.101150 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.100998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:35.101150 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.101018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-service-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.101150 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.101036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvgmh\" (UniqueName: \"kubernetes.io/projected/7c10ba3d-7759-4577-b5d6-d7da68fa9768-kube-api-access-pvgmh\") pod \"kas-connection-checker-685895c7c9-vmw5p\" (UID: \"7c10ba3d-7759-4577-b5d6-d7da68fa9768\") " pod="kube-system/kas-connection-checker-685895c7c9-vmw5p"
Oct 30 21:16:35.101150 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.101051    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df32282-d6ce-4842-b488-880dcbb49979-serving-cert\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.101150 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.101072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4w55\" (UniqueName: \"kubernetes.io/projected/2df32282-d6ce-4842-b488-880dcbb49979-kube-api-access-v4w55\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.101150 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.101097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.109982 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.109957    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:16:35.109982 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.109980    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p2m87\""
Oct 30 21:16:35.110126 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.110053    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:16:35.110126 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.110083    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:16:35.110126 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.110099    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5jmhs\""
Oct 30 21:16:35.110218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.110165    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7lps2\""
Oct 30 21:16:35.110992 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.110965    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kwbfv"]
Oct 30 21:16:35.111654 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.111619    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zdht"]
Oct 30 21:16:35.119027 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.119003    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-stjmx"]
Oct 30 21:16:35.121796 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.121665    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d7bfbd7bc-slk74"]
Oct 30 21:16:35.122279 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.122263    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"]
Oct 30 21:16:35.122886 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.122871    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"]
Oct 30 21:16:35.123459 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.123440    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"]
Oct 30 21:16:35.126876 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.126860    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:16:35.126995 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.126975    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:16:35.127056 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.126943    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127056 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.126952    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:16:35.127056 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127019    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:16:35.127056 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127025    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127056 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.126892    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127268 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127071    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127268 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127074    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127268 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127220    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127268 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127225    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127459 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127306    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127459 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127352    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127459 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127445    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:16:35.127459 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127444    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127473    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127476    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:16:35.127709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127506    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:16:35.127709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127572    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127584    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.127709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127587    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127709 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127625    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127926 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127825    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.127926 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.127862    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.128079 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.128063    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.176260 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.176230    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:16:35.201417 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lrjf\" (UniqueName: \"kubernetes.io/projected/093adaf9-e590-4301-b3f4-2d58afcf1398-kube-api-access-4lrjf\") pod \"volume-data-source-validator-58c9f5f46d-fgqwn\" (UID: \"093adaf9-e590-4301-b3f4-2d58afcf1398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"
Oct 30 21:16:35.201510 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.201510 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.201510 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcb4b95-cf9f-4cd5-8628-4d716078026d-serving-cert\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.201631 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fbe6abd-8922-454f-8ded-4e154da37cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.201631 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.201705 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.201705 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.201778 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdjj5\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.201778 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.201778 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckn2m\" (UniqueName: \"kubernetes.io/projected/07137761-f8df-48e8-b75a-5f7852665e13-kube-api-access-ckn2m\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.201873 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a1d8929-5e86-41ec-9298-26531344f8ee-nginx-conf\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:35.201873 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.201960 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbv79\" (UniqueName: \"kubernetes.io/projected/20532b77-4bbf-4b92-9321-79a2a2c55d16-kube-api-access-bbv79\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.201960 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljp4\" (UniqueName: \"kubernetes.io/projected/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-kube-api-access-jljp4\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.202060 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxck9\" (UniqueName: \"kubernetes.io/projected/1fbe6abd-8922-454f-8ded-4e154da37cbe-kube-api-access-cxck9\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.202060 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.201997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5bcf28-7601-411c-a347-80adf8270f94-config\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.202060 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202031    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.202160 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7g6j\" (UniqueName: \"kubernetes.io/projected/b9bc359e-dff6-4151-9210-553cb6cb727f-kube-api-access-b7g6j\") pod \"kas-connection-checker-685895c7c9-spg6c\" (UID: \"b9bc359e-dff6-4151-9210-553cb6cb727f\") " pod="kube-system/kas-connection-checker-685895c7c9-spg6c"
Oct 30 21:16:35.202160 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202144    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5b77\" (UniqueName: \"kubernetes.io/projected/f6248f5b-93ea-43c6-8a91-ab757ba777fa-kube-api-access-q5b77\") pod \"kas-connection-checker-685895c7c9-mdw62\" (UID: \"f6248f5b-93ea-43c6-8a91-ab757ba777fa\") " pod="kube-system/kas-connection-checker-685895c7c9-mdw62"
Oct 30 21:16:35.202218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202170    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.202218 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-trusted-ca\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.202275 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202219    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.202275 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fbe6abd-8922-454f-8ded-4e154da37cbe-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.202335 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-snapshots\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.202335 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.202389 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.202389 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:35.202447 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20532b77-4bbf-4b92-9321-79a2a2c55d16-cert\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.202447 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmdt8\" (UniqueName: \"kubernetes.io/projected/002a295e-6631-4813-96e7-a8f9936e05b3-kube-api-access-zmdt8\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.202447 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-default-certificate\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.202532 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202446    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a1d8929-5e86-41ec-9298-26531344f8ee-nginx-conf\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:35.202532 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qvqw\" (UniqueName: \"kubernetes.io/projected/bc5bcf28-7601-411c-a347-80adf8270f94-kube-api-access-7qvqw\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.202532 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-stats-auth\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.202532 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rlxf\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.202706 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.202706 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.202779 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.202818 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.202865 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-tmp\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.203004 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.203004 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.202959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.203116 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xwz8\" (UniqueName: \"kubernetes.io/projected/2bcb4b95-cf9f-4cd5-8628-4d716078026d-kube-api-access-7xwz8\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.203116 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203013    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-snapshots\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.203116 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f138350-181a-4d19-8b9a-445e4f1327d7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.203116 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002a295e-6631-4813-96e7-a8f9936e05b3-tmp-dir\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.203116 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.203350 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203169    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.203350 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203188    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-tmp\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.203350 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/002a295e-6631-4813-96e7-a8f9936e05b3-config-volume\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.203350 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-service-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.203350 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7rs4\" (UniqueName: \"kubernetes.io/projected/50545deb-2e88-4316-b8ea-60ffa646dfd2-kube-api-access-s7rs4\") pod \"network-check-source-6f78d59f99-mddn5\" (UID: \"50545deb-2e88-4316-b8ea-60ffa646dfd2\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"
Oct 30 21:16:35.203350 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.203616 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5bcf28-7601-411c-a347-80adf8270f94-serving-cert\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.203616 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgmh\" (UniqueName: \"kubernetes.io/projected/7c10ba3d-7759-4577-b5d6-d7da68fa9768-kube-api-access-pvgmh\") pod \"kas-connection-checker-685895c7c9-vmw5p\" (UID: \"7c10ba3d-7759-4577-b5d6-d7da68fa9768\") " pod="kube-system/kas-connection-checker-685895c7c9-vmw5p"
Oct 30 21:16:35.203616 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df32282-d6ce-4842-b488-880dcbb49979-serving-cert\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.203616 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxgh9\" (UniqueName: \"kubernetes.io/projected/5f138350-181a-4d19-8b9a-445e4f1327d7-kube-api-access-gxgh9\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.203811 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-config\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.203811 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4w55\" (UniqueName: \"kubernetes.io/projected/2df32282-d6ce-4842-b488-880dcbb49979-kube-api-access-v4w55\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.203897 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.203826    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-service-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.207088 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.207067    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df32282-d6ce-4842-b488-880dcbb49979-serving-cert\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.209125 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209107    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:16:35.209125 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209122    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:16:35.209330 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209304    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:16:35.209393 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209349    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:16:35.209393 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209354    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:16:35.209477 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209409    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:16:35.209477 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209459    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:16:35.209583 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209500    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:16:35.209583 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209507    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:16:35.209583 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209530    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:16:35.209583 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209569    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:16:35.209583 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209577    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-6wvjk\""
Oct 30 21:16:35.209583 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209583    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:16:35.209853 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209527    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:16:35.209853 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209598    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:16:35.209853 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209626    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:16:35.209853 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209659    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fxr9c\""
Oct 30 21:16:35.209853 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209671    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-t44zw\""
Oct 30 21:16:35.209853 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209713    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:16:35.209853 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.209821    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42q2c\""
Oct 30 21:16:35.210228 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.210206    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:16:35.212817 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.212801    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:35.212882 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.212867    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.712848563 +0000 UTC m=+32.144589808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:35.213357 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.213341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.227321 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.227283    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:16:35.227321 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.227315    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:16:35.227415 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.227345    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:16:35.258523 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.258496    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5b77\" (UniqueName: \"kubernetes.io/projected/f6248f5b-93ea-43c6-8a91-ab757ba777fa-kube-api-access-q5b77\") pod \"kas-connection-checker-685895c7c9-mdw62\" (UID: \"f6248f5b-93ea-43c6-8a91-ab757ba777fa\") " pod="kube-system/kas-connection-checker-685895c7c9-mdw62"
Oct 30 21:16:35.259259 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.259240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7g6j\" (UniqueName: \"kubernetes.io/projected/b9bc359e-dff6-4151-9210-553cb6cb727f-kube-api-access-b7g6j\") pod \"kas-connection-checker-685895c7c9-spg6c\" (UID: \"b9bc359e-dff6-4151-9210-553cb6cb727f\") " pod="kube-system/kas-connection-checker-685895c7c9-spg6c"
Oct 30 21:16:35.259601 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.259584    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4w55\" (UniqueName: \"kubernetes.io/projected/2df32282-d6ce-4842-b488-880dcbb49979-kube-api-access-v4w55\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.259669 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.259654    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgmh\" (UniqueName: \"kubernetes.io/projected/7c10ba3d-7759-4577-b5d6-d7da68fa9768-kube-api-access-pvgmh\") pod \"kas-connection-checker-685895c7c9-vmw5p\" (UID: \"7c10ba3d-7759-4577-b5d6-d7da68fa9768\") " pod="kube-system/kas-connection-checker-685895c7c9-vmw5p"
Oct 30 21:16:35.284156 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.284134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-vmw5p"
Oct 30 21:16:35.304508 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.304607 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbv79\" (UniqueName: \"kubernetes.io/projected/20532b77-4bbf-4b92-9321-79a2a2c55d16-kube-api-access-bbv79\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.304607 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljp4\" (UniqueName: \"kubernetes.io/projected/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-kube-api-access-jljp4\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.304607 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxck9\" (UniqueName: \"kubernetes.io/projected/1fbe6abd-8922-454f-8ded-4e154da37cbe-kube-api-access-cxck9\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.304607 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304597    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5bcf28-7601-411c-a347-80adf8270f94-config\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.304815 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.304815 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304663    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.304815 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-trusted-ca\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.304815 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.305012 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fbe6abd-8922-454f-8ded-4e154da37cbe-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.305012 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.305012 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.305012 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20532b77-4bbf-4b92-9321-79a2a2c55d16-cert\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.305012 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.304991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdt8\" (UniqueName: \"kubernetes.io/projected/002a295e-6631-4813-96e7-a8f9936e05b3-kube-api-access-zmdt8\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-default-certificate\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qvqw\" (UniqueName: \"kubernetes.io/projected/bc5bcf28-7601-411c-a347-80adf8270f94-kube-api-access-7qvqw\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-stats-auth\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305083    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305083    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlxf\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.305167    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.305240 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.305218    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.805201211 +0000 UTC m=+32.236942454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.305253    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.305288    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.80527676 +0000 UTC m=+32.237018005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305329    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xwz8\" (UniqueName: \"kubernetes.io/projected/2bcb4b95-cf9f-4cd5-8628-4d716078026d-kube-api-access-7xwz8\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f138350-181a-4d19-8b9a-445e4f1327d7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002a295e-6631-4813-96e7-a8f9936e05b3-tmp-dir\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/002a295e-6631-4813-96e7-a8f9936e05b3-config-volume\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305504    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fbe6abd-8922-454f-8ded-4e154da37cbe-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rs4\" (UniqueName: \"kubernetes.io/projected/50545deb-2e88-4316-b8ea-60ffa646dfd2-kube-api-access-s7rs4\") pod \"network-check-source-6f78d59f99-mddn5\" (UID: \"50545deb-2e88-4316-b8ea-60ffa646dfd2\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305604    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.305735 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5bcf28-7601-411c-a347-80adf8270f94-serving-cert\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxgh9\" (UniqueName: \"kubernetes.io/projected/5f138350-181a-4d19-8b9a-445e4f1327d7-kube-api-access-gxgh9\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-config\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lrjf\" (UniqueName: \"kubernetes.io/projected/093adaf9-e590-4301-b3f4-2d58afcf1398-kube-api-access-4lrjf\") pod \"volume-data-source-validator-58c9f5f46d-fgqwn\" (UID: \"093adaf9-e590-4301-b3f4-2d58afcf1398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcb4b95-cf9f-4cd5-8628-4d716078026d-serving-cert\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305843    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fbe6abd-8922-454f-8ded-4e154da37cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.305973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdjj5\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306104    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/002a295e-6631-4813-96e7-a8f9936e05b3-config-volume\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306143    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.306485 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306242    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5bcf28-7601-411c-a347-80adf8270f94-config\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306252    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f138350-181a-4d19-8b9a-445e4f1327d7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306331    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckn2m\" (UniqueName: \"kubernetes.io/projected/07137761-f8df-48e8-b75a-5f7852665e13-kube-api-access-ckn2m\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306406    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002a295e-6631-4813-96e7-a8f9936e05b3-tmp-dir\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306599    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.806581051 +0000 UTC m=+32.238322285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306657    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306673    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306673    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.8066618 +0000 UTC m=+32.238403060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306732    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.806715495 +0000 UTC m=+32.238456737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306828    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306845    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.306888    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.806875263 +0000 UTC m=+32.238616506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:35.307258 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.306897    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-trusted-ca\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.307920 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.307344    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.307920 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.307435    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.307920 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.307629    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.308545 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.308515    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-config\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.308903 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.308882    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:35.308976 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.308903    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-default-certificate\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.308976 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.308949    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:35.80893541 +0000 UTC m=+32.240676656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:35.309298 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.309272    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20532b77-4bbf-4b92-9321-79a2a2c55d16-cert\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.309868 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.309842    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-stats-auth\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.310098 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.310068    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcb4b95-cf9f-4cd5-8628-4d716078026d-serving-cert\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.310205 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.310123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5bcf28-7601-411c-a347-80adf8270f94-serving-cert\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.311095 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.311066    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.311699 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.311679    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.311922 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.311905    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.312209 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.312178    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.312856 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.312838    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fbe6abd-8922-454f-8ded-4e154da37cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.330281 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.330263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-spg6c"
Oct 30 21:16:35.332975 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.332880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mdw62"
Oct 30 21:16:35.364953 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.362638    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmdt8\" (UniqueName: \"kubernetes.io/projected/002a295e-6631-4813-96e7-a8f9936e05b3-kube-api-access-zmdt8\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.364953 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.363086    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljp4\" (UniqueName: \"kubernetes.io/projected/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-kube-api-access-jljp4\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.364953 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.363190    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxck9\" (UniqueName: \"kubernetes.io/projected/1fbe6abd-8922-454f-8ded-4e154da37cbe-kube-api-access-cxck9\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.368685 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.366287    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:35.368685 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.366596    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lrjf\" (UniqueName: \"kubernetes.io/projected/093adaf9-e590-4301-b3f4-2d58afcf1398-kube-api-access-4lrjf\") pod \"volume-data-source-validator-58c9f5f46d-fgqwn\" (UID: \"093adaf9-e590-4301-b3f4-2d58afcf1398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"
Oct 30 21:16:35.368685 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.366711    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qvqw\" (UniqueName: \"kubernetes.io/projected/bc5bcf28-7601-411c-a347-80adf8270f94-kube-api-access-7qvqw\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.368685 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.368002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbv79\" (UniqueName: \"kubernetes.io/projected/20532b77-4bbf-4b92-9321-79a2a2c55d16-kube-api-access-bbv79\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.368685 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.368014    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rlxf\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.368964 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.368892    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.368964 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.368927    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdjj5\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.369958 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.369931    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rs4\" (UniqueName: \"kubernetes.io/projected/50545deb-2e88-4316-b8ea-60ffa646dfd2-kube-api-access-s7rs4\") pod \"network-check-source-6f78d59f99-mddn5\" (UID: \"50545deb-2e88-4316-b8ea-60ffa646dfd2\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"
Oct 30 21:16:35.370863 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.370831    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckn2m\" (UniqueName: \"kubernetes.io/projected/07137761-f8df-48e8-b75a-5f7852665e13-kube-api-access-ckn2m\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.371009 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.370961    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.371679 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.371651    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xwz8\" (UniqueName: \"kubernetes.io/projected/2bcb4b95-cf9f-4cd5-8628-4d716078026d-kube-api-access-7xwz8\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.372221 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.372199    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxgh9\" (UniqueName: \"kubernetes.io/projected/5f138350-181a-4d19-8b9a-445e4f1327d7-kube-api-access-gxgh9\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.393969 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.393258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:35.408516 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.408494    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:35.413858 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.413673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:35.442095 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.441111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"
Oct 30 21:16:35.451588 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.450678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"
Oct 30 21:16:35.458867 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.458687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:35.663743 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.663647    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-vmw5p"]
Oct 30 21:16:35.666968 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.666943    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c10ba3d_7759_4577_b5d6_d7da68fa9768.slice/crio-e078280fdf0bae240017539b501ab4e7ae859b35493bc9712a750a77c2811b42 WatchSource:0}: Error finding container e078280fdf0bae240017539b501ab4e7ae859b35493bc9712a750a77c2811b42: Status 404 returned error can't find the container with id e078280fdf0bae240017539b501ab4e7ae859b35493bc9712a750a77c2811b42
Oct 30 21:16:35.715591 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.715491    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-spg6c"]
Oct 30 21:16:35.716710 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.716650    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mdw62"]
Oct 30 21:16:35.721267 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.719521    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bc359e_dff6_4151_9210_553cb6cb727f.slice/crio-cbe635adbcb1a90bc4d03bdb37ee0f7b61571be8b68970cb1d320b89a1155ca0 WatchSource:0}: Error finding container cbe635adbcb1a90bc4d03bdb37ee0f7b61571be8b68970cb1d320b89a1155ca0: Status 404 returned error can't find the container with id cbe635adbcb1a90bc4d03bdb37ee0f7b61571be8b68970cb1d320b89a1155ca0
Oct 30 21:16:35.727148 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.727077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:35.758194 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.757205    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-d7kds"]
Oct 30 21:16:35.762898 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.762871    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df32282_d6ce_4842_b488_880dcbb49979.slice/crio-77fdd5229326713d9ce865c82f87a54b1f20a802b8dc93b3f5351b7fc7d56863 WatchSource:0}: Error finding container 77fdd5229326713d9ce865c82f87a54b1f20a802b8dc93b3f5351b7fc7d56863: Status 404 returned error can't find the container with id 77fdd5229326713d9ce865c82f87a54b1f20a802b8dc93b3f5351b7fc7d56863
Oct 30 21:16:35.794719 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.794602    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"]
Oct 30 21:16:35.798703 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.798672    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc5bcf28_7601_411c_a347_80adf8270f94.slice/crio-b0626a4c9787ce3d95d6fc172c900c530857639f75e60ba660963b2cd0e955a7 WatchSource:0}: Error finding container b0626a4c9787ce3d95d6fc172c900c530857639f75e60ba660963b2cd0e955a7: Status 404 returned error can't find the container with id b0626a4c9787ce3d95d6fc172c900c530857639f75e60ba660963b2cd0e955a7
Oct 30 21:16:35.812391 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:35.812500 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:35.812500 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.812500 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:35.812681 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812527    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:35.812681 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812605    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.812584617 +0000 UTC m=+33.244325859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:35.812681 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:35.812681 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812622    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:35.812681 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812643    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:35.812681 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812672    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.812656244 +0000 UTC m=+33.244397489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812695    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.812685409 +0000 UTC m=+33.244426639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812716    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.81270736 +0000 UTC m=+33.244448620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812739    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812776    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.812762516 +0000 UTC m=+33.244503762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812801    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812822    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.812816064 +0000 UTC m=+33.244557335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.812846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812873    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:35.812910 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812910    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:35.813426 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812934    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:35.813426 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812943    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:35.813426 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812935    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.812927408 +0000 UTC m=+33.244668636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:35.813426 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:35.812971    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:36.812964707 +0000 UTC m=+33.244705935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:35.822802 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.822777    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"]
Oct 30 21:16:35.826784 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.825424    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"]
Oct 30 21:16:35.829428 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.829229    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcb4b95_cf9f_4cd5_8628_4d716078026d.slice/crio-af4a55fdd5be7578a1d7f58e4328a8915963ea71e97d06d1049aec2103976c10 WatchSource:0}: Error finding container af4a55fdd5be7578a1d7f58e4328a8915963ea71e97d06d1049aec2103976c10: Status 404 returned error can't find the container with id af4a55fdd5be7578a1d7f58e4328a8915963ea71e97d06d1049aec2103976c10
Oct 30 21:16:35.891944 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.891910    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"]
Oct 30 21:16:35.895281 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.895252    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093adaf9_e590_4301_b3f4_2d58afcf1398.slice/crio-a61a52c7ac4be1eb9dc8d46be5c9d3b3a8baa95d131a65a04194242637b6d1dc WatchSource:0}: Error finding container a61a52c7ac4be1eb9dc8d46be5c9d3b3a8baa95d131a65a04194242637b6d1dc: Status 404 returned error can't find the container with id a61a52c7ac4be1eb9dc8d46be5c9d3b3a8baa95d131a65a04194242637b6d1dc
Oct 30 21:16:35.895391 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.895350    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"]
Oct 30 21:16:35.898833 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.898812    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50545deb_2e88_4316_b8ea_60ffa646dfd2.slice/crio-4283286ee54d92516f72572bf9aee28cbca1b875096a46f19a02f14988dc7683 WatchSource:0}: Error finding container 4283286ee54d92516f72572bf9aee28cbca1b875096a46f19a02f14988dc7683: Status 404 returned error can't find the container with id 4283286ee54d92516f72572bf9aee28cbca1b875096a46f19a02f14988dc7683
Oct 30 21:16:35.915609 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.915590    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kwbfv"]
Oct 30 21:16:35.918207 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:35.918188    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20532b77_4bbf_4b92_9321_79a2a2c55d16.slice/crio-0a0d093969d4f15a00a1359a0d2a488c6e6cd3c01ba9f99b2551aae6ad98e9c2 WatchSource:0}: Error finding container 0a0d093969d4f15a00a1359a0d2a488c6e6cd3c01ba9f99b2551aae6ad98e9c2: Status 404 returned error can't find the container with id 0a0d093969d4f15a00a1359a0d2a488c6e6cd3c01ba9f99b2551aae6ad98e9c2
Oct 30 21:16:35.971001 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:35.970978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:36.254707 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.254676    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-vmw5p" event={"ID":"7c10ba3d-7759-4577-b5d6-d7da68fa9768","Type":"ContainerStarted","Data":"8cc1569a70e2a019652c04858ca76ae30486b335b32efad7f7d91e401b23784a"}
Oct 30 21:16:36.254846 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.254717    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-vmw5p" event={"ID":"7c10ba3d-7759-4577-b5d6-d7da68fa9768","Type":"ContainerStarted","Data":"e078280fdf0bae240017539b501ab4e7ae859b35493bc9712a750a77c2811b42"}
Oct 30 21:16:36.255862 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.255833    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5" event={"ID":"50545deb-2e88-4316-b8ea-60ffa646dfd2","Type":"ContainerStarted","Data":"4283286ee54d92516f72572bf9aee28cbca1b875096a46f19a02f14988dc7683"}
Oct 30 21:16:36.256873 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.256851    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22" event={"ID":"bc5bcf28-7601-411c-a347-80adf8270f94","Type":"ContainerStarted","Data":"b0626a4c9787ce3d95d6fc172c900c530857639f75e60ba660963b2cd0e955a7"}
Oct 30 21:16:36.257898 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.257880    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-d7kds" event={"ID":"2df32282-d6ce-4842-b488-880dcbb49979","Type":"ContainerStarted","Data":"77fdd5229326713d9ce865c82f87a54b1f20a802b8dc93b3f5351b7fc7d56863"}
Oct 30 21:16:36.259266 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.259246    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mdw62" event={"ID":"f6248f5b-93ea-43c6-8a91-ab757ba777fa","Type":"ContainerStarted","Data":"491ca61a36907335ba1d34269688b66dda25a185f09c930f0c7a5c735d11b748"}
Oct 30 21:16:36.259339 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.259286    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mdw62" event={"ID":"f6248f5b-93ea-43c6-8a91-ab757ba777fa","Type":"ContainerStarted","Data":"759f5c46cce4d846674af915abf6485a72bfe352813d1e8e8bfcc853b97dad7b"}
Oct 30 21:16:36.260367 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.260348    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kwbfv" event={"ID":"20532b77-4bbf-4b92-9321-79a2a2c55d16","Type":"ContainerStarted","Data":"0a0d093969d4f15a00a1359a0d2a488c6e6cd3c01ba9f99b2551aae6ad98e9c2"}
Oct 30 21:16:36.261377 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.261355    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" event={"ID":"2bcb4b95-cf9f-4cd5-8628-4d716078026d","Type":"ContainerStarted","Data":"af4a55fdd5be7578a1d7f58e4328a8915963ea71e97d06d1049aec2103976c10"}
Oct 30 21:16:36.262457 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.262440    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn" event={"ID":"093adaf9-e590-4301-b3f4-2d58afcf1398","Type":"ContainerStarted","Data":"a61a52c7ac4be1eb9dc8d46be5c9d3b3a8baa95d131a65a04194242637b6d1dc"}
Oct 30 21:16:36.263474 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.263458    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd" event={"ID":"1fbe6abd-8922-454f-8ded-4e154da37cbe","Type":"ContainerStarted","Data":"93ba31de8c166b550af84dab18811b5f667b0970e362facba25fed0b97de217d"}
Oct 30 21:16:36.264769 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.264753    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-spg6c" event={"ID":"b9bc359e-dff6-4151-9210-553cb6cb727f","Type":"ContainerStarted","Data":"7bb10b8c96ece15c49163714a75a5ed38593e90bdf859a6aa9bcea2aca9318d1"}
Oct 30 21:16:36.264835 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.264781    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-spg6c" event={"ID":"b9bc359e-dff6-4151-9210-553cb6cb727f","Type":"ContainerStarted","Data":"cbe635adbcb1a90bc4d03bdb37ee0f7b61571be8b68970cb1d320b89a1155ca0"}
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821384    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821459    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821436293 +0000 UTC m=+35.253177538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821475    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821525    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821510288 +0000 UTC m=+35.253251529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821594    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:36.821669    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821599    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821654    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821774    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821775    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821696    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:36.821915 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821794    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:36.822772 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821743    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821735087 +0000 UTC m=+35.253476314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:36.822772 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821816    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821809735 +0000 UTC m=+35.253550963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:36.822772 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821826    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821820708 +0000 UTC m=+35.253561936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:36.822772 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821837    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821830355 +0000 UTC m=+35.253571582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:36.822772 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821846    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821841971 +0000 UTC m=+35.253583200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:36.822772 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821857    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:36.822772 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:36.821895    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:38.821883101 +0000 UTC m=+35.253624356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:37.025017 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.024392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:37.025017 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.024482    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:37.025017 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:37.024689    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:16:37.025017 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:37.024758    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:17:09.024738067 +0000 UTC m=+65.456479296 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : secret "metrics-daemon-secret" not found
Oct 30 21:16:37.045788 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.045761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:37.124478 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.124381    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-spg6c" podStartSLOduration=421.124362892 podStartE2EDuration="7m1.124362892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:37.123590644 +0000 UTC m=+33.555331896" watchObservedRunningTime="2026-10-30 21:16:37.124362892 +0000 UTC m=+33.556104145"
Oct 30 21:16:37.125657 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.125623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:37.128846 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.128816    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:37.149893 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.149844    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:37.157786 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.157620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:37.240549 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.240495    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-mdw62" podStartSLOduration=421.240476768 podStartE2EDuration="7m1.240476768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:37.238754169 +0000 UTC m=+33.670495420" watchObservedRunningTime="2026-10-30 21:16:37.240476768 +0000 UTC m=+33.672218021"
Oct 30 21:16:37.557252 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.556743    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-vmw5p" podStartSLOduration=421.55672276 podStartE2EDuration="7m1.55672276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:09:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:37.354253717 +0000 UTC m=+33.785994970" watchObservedRunningTime="2026-10-30 21:16:37.55672276 +0000 UTC m=+33.988464011"
Oct 30 21:16:37.560808 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.560492    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2g9kx"]
Oct 30 21:16:37.566934 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:37.566910    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f80d0e_54bd_400f_9b86_7103ea34895a.slice/crio-31ad0b621c6638947a3501f5343d8af38486e1f0ed193cdff179aac8e807ae36 WatchSource:0}: Error finding container 31ad0b621c6638947a3501f5343d8af38486e1f0ed193cdff179aac8e807ae36: Status 404 returned error can't find the container with id 31ad0b621c6638947a3501f5343d8af38486e1f0ed193cdff179aac8e807ae36
Oct 30 21:16:37.596654 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:37.596630    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cmvnx"]
Oct 30 21:16:37.601658 ip-10-0-135-205 kubenswrapper[2581]: W1030 21:16:37.601629    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00eb7bfc_9f77_4129_a1c7_d3a1e8f21d68.slice/crio-34f31269cd9f6e5178311a764f7f2a004bb08d9153dddc5dba273ff020ed776f WatchSource:0}: Error finding container 34f31269cd9f6e5178311a764f7f2a004bb08d9153dddc5dba273ff020ed776f: Status 404 returned error can't find the container with id 34f31269cd9f6e5178311a764f7f2a004bb08d9153dddc5dba273ff020ed776f
Oct 30 21:16:38.280138 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.280054    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmvnx" event={"ID":"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68","Type":"ContainerStarted","Data":"34f31269cd9f6e5178311a764f7f2a004bb08d9153dddc5dba273ff020ed776f"}
Oct 30 21:16:38.282510 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.282477    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2g9kx" event={"ID":"26f80d0e-54bd-400f-9b86-7103ea34895a","Type":"ContainerStarted","Data":"31ad0b621c6638947a3501f5343d8af38486e1f0ed193cdff179aac8e807ae36"}
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842297    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:38.842521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.842671    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.842737    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.842718862 +0000 UTC m=+39.274460092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843138    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843186    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.843171367 +0000 UTC m=+39.274912600 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843249    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843261    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843295    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.843284487 +0000 UTC m=+39.275025721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843350    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:38.843828 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843359    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843387    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.843377797 +0000 UTC m=+39.275119028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843440    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843468    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.843459465 +0000 UTC m=+39.275200698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843527    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843575    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.84354735 +0000 UTC m=+39.275288579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843641    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.843632084 +0000 UTC m=+39.275373314 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843716    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:38.844752 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:38.843745    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:42.843736536 +0000 UTC m=+39.275477767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:39.288267 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:39.287536    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn" event={"ID":"093adaf9-e590-4301-b3f4-2d58afcf1398","Type":"ContainerStarted","Data":"ce87164c1ff7cd9bbc23fc904a3c4f9f5e2127c25a1880dc8702c6eb9378d3ef"}
Oct 30 21:16:39.410080 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:39.410015    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn" podStartSLOduration=391.888894877 podStartE2EDuration="6m34.409996003s" totalImagesPullingTime="2.521101126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:39.4098609 +0000 UTC m=+35.841602151" watchObservedRunningTime="2026-10-30 21:16:39.409996003 +0000 UTC m=+35.841737254"
Oct 30 21:16:39.547393 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:39.547311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:39.730236 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:39.730200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:41.181716 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.181685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:41.299537 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.299467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/0.log"
Oct 30 21:16:41.299537 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.299513    2581 generic.go:356] "Generic (PLEG): container finished" podID="2bcb4b95-cf9f-4cd5-8628-4d716078026d" containerID="5af890e82aee8712dbbae1bd59a85b4e17ac2c295e0465311a3c8d2b1b37f241" exitCode=255
Oct 30 21:16:41.299761 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.299629    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" event={"ID":"2bcb4b95-cf9f-4cd5-8628-4d716078026d","Type":"ContainerDied","Data":"5af890e82aee8712dbbae1bd59a85b4e17ac2c295e0465311a3c8d2b1b37f241"}
Oct 30 21:16:41.300521 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.299989    2581 scope.go:122] "RemoveContainer" containerID="5af890e82aee8712dbbae1bd59a85b4e17ac2c295e0465311a3c8d2b1b37f241"
Oct 30 21:16:41.303254 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.303225    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd" event={"ID":"1fbe6abd-8922-454f-8ded-4e154da37cbe","Type":"ContainerStarted","Data":"780493962fa3ecbcc715bb085f987974b3cc65acc7f921a7b8fdd957d4630b11"}
Oct 30 21:16:41.305716 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.305631    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22" event={"ID":"bc5bcf28-7601-411c-a347-80adf8270f94","Type":"ContainerStarted","Data":"5106bd586dd26ec3282c5794fe8cc7f43defe233c41674108336dff25a948bbb"}
Oct 30 21:16:41.309387 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.308963    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-d7kds" event={"ID":"2df32282-d6ce-4842-b488-880dcbb49979","Type":"ContainerStarted","Data":"ee2ae4f59f6c4cc8ba2ef2a53522cc7a978e04aae85a23f163fbeac9aceaf74c"}
Oct 30 21:16:41.350783 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.350724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:41.530886 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.530834    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-d7kds" podStartSLOduration=390.445995558 podStartE2EDuration="6m35.530819623s" totalImagesPullingTime="5.084824065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:41.528858548 +0000 UTC m=+37.960599800" watchObservedRunningTime="2026-10-30 21:16:41.530819623 +0000 UTC m=+37.962560917"
Oct 30 21:16:41.648854 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.646777    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22" podStartSLOduration=393.83248856 podStartE2EDuration="6m38.646756951s" totalImagesPullingTime="4.814268391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:41.641648937 +0000 UTC m=+38.073390188" watchObservedRunningTime="2026-10-30 21:16:41.646756951 +0000 UTC m=+38.078498203"
Oct 30 21:16:41.765711 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.765626    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd" podStartSLOduration=393.646558854 podStartE2EDuration="6m38.765605514s" totalImagesPullingTime="5.11904666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:41.764874176 +0000 UTC m=+38.196615428" watchObservedRunningTime="2026-10-30 21:16:41.765605514 +0000 UTC m=+38.197346764"
Oct 30 21:16:41.966307 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:41.966250    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:42.168195 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.168158    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:42.316295 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.316270    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/1.log"
Oct 30 21:16:42.318604 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.316839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/0.log"
Oct 30 21:16:42.318604 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.316878    2581 generic.go:356] "Generic (PLEG): container finished" podID="2bcb4b95-cf9f-4cd5-8628-4d716078026d" containerID="2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415" exitCode=255
Oct 30 21:16:42.318604 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.317835    2581 scope.go:122] "RemoveContainer" containerID="2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415"
Oct 30 21:16:42.318604 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.318063    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2vz6h_openshift-console-operator(2bcb4b95-cf9f-4cd5-8628-4d716078026d)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" podUID="2bcb4b95-cf9f-4cd5-8628-4d716078026d"
Oct 30 21:16:42.318604 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.318118    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" event={"ID":"2bcb4b95-cf9f-4cd5-8628-4d716078026d","Type":"ContainerDied","Data":"2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415"}
Oct 30 21:16:42.318604 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.318264    2581 scope.go:122] "RemoveContainer" containerID="5af890e82aee8712dbbae1bd59a85b4e17ac2c295e0465311a3c8d2b1b37f241"
Oct 30 21:16:42.348803 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.348769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:42.424320 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.424287    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-57nxn"]
Oct 30 21:16:42.427209 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.427184    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.471937 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.471901    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57nxn"]
Oct 30 21:16:42.501471 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.501144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01942c94-e80e-4d86-8b44-529875c8d589-crio-socket\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.501471 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.501220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01942c94-e80e-4d86-8b44-529875c8d589-data-volume\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.501471 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.501306    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4fcs\" (UniqueName: \"kubernetes.io/projected/01942c94-e80e-4d86-8b44-529875c8d589-kube-api-access-j4fcs\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.501471 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.501339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.501471 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.501355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.534547 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.534468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:42.538287 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.538234    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:16:42.547300 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.547204    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z7dj2\""
Oct 30 21:16:42.547300 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.547273    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:16:42.602857 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.602758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.602857 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.602808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.603136 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.602913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01942c94-e80e-4d86-8b44-529875c8d589-crio-socket\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.603136 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.602971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01942c94-e80e-4d86-8b44-529875c8d589-data-volume\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.603136 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.603079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4fcs\" (UniqueName: \"kubernetes.io/projected/01942c94-e80e-4d86-8b44-529875c8d589-kube-api-access-j4fcs\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.603492 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.603472    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:16:42.603591 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.603543    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:43.103525289 +0000 UTC m=+39.535266531 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : configmap "kube-rbac-proxy" not found
Oct 30 21:16:42.603792 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.603770    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:42.603861 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.603811    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:43.103800921 +0000 UTC m=+39.535542165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:42.603926 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.603870    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01942c94-e80e-4d86-8b44-529875c8d589-crio-socket\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.604201 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.604178    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01942c94-e80e-4d86-8b44-529875c8d589-data-volume\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.666523 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.666461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4fcs\" (UniqueName: \"kubernetes.io/projected/01942c94-e80e-4d86-8b44-529875c8d589-kube-api-access-j4fcs\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:42.725440 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.725375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:42.808543 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.808243    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"]
Oct 30 21:16:42.811332 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.811297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"
Oct 30 21:16:42.867808 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.867739    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"]
Oct 30 21:16:42.906086 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:42.906192 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:42.906246 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:42.906246 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906214    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:42.906246 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:42.906397 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906281    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906261846 +0000 UTC m=+47.338003091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:42.906397 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:42.906397 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906365    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:42.906397 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:42.906603 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnm8j\" (UniqueName: \"kubernetes.io/projected/df00af45-5cd4-4831-be47-b11a225559c2-kube-api-access-rnm8j\") pod \"migrator-66df5d496b-vj4nf\" (UID: \"df00af45-5cd4-4831-be47-b11a225559c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"
Oct 30 21:16:42.906603 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906411    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906395305 +0000 UTC m=+47.338136533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:42.906603 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:42.906603 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906499    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:42.906603 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.906520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:42.906603 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906544    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906529241 +0000 UTC m=+47.338270473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906614    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906652    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906668    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906654    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906641945 +0000 UTC m=+47.338383186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906737    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906721735 +0000 UTC m=+47.338462964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906714    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906756    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906745428 +0000 UTC m=+47.338486657 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906762    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906764    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906804    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906790903 +0000 UTC m=+47.338532136 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:42.906893 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:42.906821    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.906812103 +0000 UTC m=+47.338553334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:42.909791 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.909763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:42.949747 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.949721    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pc6p4\""
Oct 30 21:16:42.956822 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.956799    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:42.956924 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:42.956890    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:16:43.007144 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.007115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnm8j\" (UniqueName: \"kubernetes.io/projected/df00af45-5cd4-4831-be47-b11a225559c2-kube-api-access-rnm8j\") pod \"migrator-66df5d496b-vj4nf\" (UID: \"df00af45-5cd4-4831-be47-b11a225559c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"
Oct 30 21:16:43.065618 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.065592    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnm8j\" (UniqueName: \"kubernetes.io/projected/df00af45-5cd4-4831-be47-b11a225559c2-kube-api-access-rnm8j\") pod \"migrator-66df5d496b-vj4nf\" (UID: \"df00af45-5cd4-4831-be47-b11a225559c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"
Oct 30 21:16:43.090937 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.090908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:43.108669 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.108642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:43.108798 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.108674    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:43.108798 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:43.108779    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:16:43.108895 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:43.108846    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:44.108828271 +0000 UTC m=+40.540569514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : configmap "kube-rbac-proxy" not found
Oct 30 21:16:43.108895 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:43.108883    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:43.109003 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:43.108947    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:44.108929067 +0000 UTC m=+40.540670308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:43.125945 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.125876    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"
Oct 30 21:16:43.268003 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.267962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:43.341395 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.340711    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kwbfv" event={"ID":"20532b77-4bbf-4b92-9321-79a2a2c55d16","Type":"ContainerStarted","Data":"d67d02c68075a2baf3b1cd941907f3892f6ecd49b24a30d46f8fc085931538a7"}
Oct 30 21:16:43.346255 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.346231    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/1.log"
Oct 30 21:16:43.346676 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.346657    2581 scope.go:122] "RemoveContainer" containerID="2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415"
Oct 30 21:16:43.346866 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:43.346842    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2vz6h_openshift-console-operator(2bcb4b95-cf9f-4cd5-8628-4d716078026d)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" podUID="2bcb4b95-cf9f-4cd5-8628-4d716078026d"
Oct 30 21:16:43.348475 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.348427    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5" event={"ID":"50545deb-2e88-4316-b8ea-60ffa646dfd2","Type":"ContainerStarted","Data":"5aeaa28ffc439f179345fbc077bcb3c62d324b7630e855e9ea47e4f250cf08d5"}
Oct 30 21:16:43.449302 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.449267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:43.457953 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.457903    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kwbfv" podStartSLOduration=3.077147101 podStartE2EDuration="9.457889193s" totalImagesPullingTime="6.380742092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:43.457020802 +0000 UTC m=+39.888762076" watchObservedRunningTime="2026-10-30 21:16:43.457889193 +0000 UTC m=+39.889630442"
Oct 30 21:16:43.516319 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.516294    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"]
Oct 30 21:16:43.686487 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:43.686437    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5" podStartSLOduration=389.689194957 podStartE2EDuration="6m36.68641902s" totalImagesPullingTime="6.997224063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:43.684966976 +0000 UTC m=+40.116708227" watchObservedRunningTime="2026-10-30 21:16:43.68641902 +0000 UTC m=+40.118160277"
Oct 30 21:16:44.059743 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:44.059686    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:44.117221 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:44.117181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:44.117221 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:44.117235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:44.117928 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:44.117566    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:44.117928 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:44.117630    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:46.117615755 +0000 UTC m=+42.549356984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:44.118143 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:44.117981    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:16:44.118143 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:44.118037    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:46.118019768 +0000 UTC m=+42.549761002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : configmap "kube-rbac-proxy" not found
Oct 30 21:16:44.355421 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:44.355345    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cmvnx" event={"ID":"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68","Type":"ContainerStarted","Data":"79c562c66524abdea5a49e549bbf0950e8e7381fe9ba98bd8aec76e565acf654"}
Oct 30 21:16:44.355899 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:44.355452    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:44.357045 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:44.357010    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf" event={"ID":"df00af45-5cd4-4831-be47-b11a225559c2","Type":"ContainerStarted","Data":"fa8606315b77f6cd1874296e544f69b11c4bd3d45660d6e7cdf6110c03825733"}
Oct 30 21:16:44.471596 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:44.471522    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cmvnx" podStartSLOduration=33.605698855 podStartE2EDuration="39.471507123s" totalImagesPullingTime="5.865808268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:16:44.470059916 +0000 UTC m=+40.901801168" watchObservedRunningTime="2026-10-30 21:16:44.471507123 +0000 UTC m=+40.903248372"
Oct 30 21:16:45.365321 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:45.365229    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2g9kx" event={"ID":"26f80d0e-54bd-400f-9b86-7103ea34895a","Type":"ContainerStarted","Data":"b4bf530639fdea63f6f058d3e7e3035dad31062655f8615dd647fb6e5befd157"}
Oct 30 21:16:45.366837 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:45.366810    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf" event={"ID":"df00af45-5cd4-4831-be47-b11a225559c2","Type":"ContainerStarted","Data":"396bc071a70c0f1ae6a17bf9b9f80a263fbf77224cb7a01a2c052072ea3e6fcc"}
Oct 30 21:16:45.409357 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:45.409328    2581 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:45.409481 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:45.409381    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:45.409776 ip-10-0-135-205 kubenswrapper[2581]: I1030 21:16:45.409760    2581 scope.go:122] "RemoveContainer" containerID="2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415"
Oct 30 21:16:45.409967 ip-10-0-135-205 kubenswrapper[2581]: E1030 21:16:45.409947    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2vz6h_openshift-console-operator(2bcb4b95-cf9f-4cd5-8628-4d716078026d)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" podUID="2bcb4b95-cf9f-4cd5-8628-4d716078026d"
Oct 30 21:16:45.432458 ip-10-0-135-205 systemd[1]: Stopping Kubernetes Kubelet...
Oct 30 21:16:45.449916 ip-10-0-135-205 systemd[1]: kubelet.service: Deactivated successfully.
Oct 30 21:16:45.450124 ip-10-0-135-205 systemd[1]: Stopped Kubernetes Kubelet.
Oct 30 21:16:45.450182 ip-10-0-135-205 systemd[1]: kubelet.service: Consumed 2.974s CPU time.
Oct 30 21:16:45.461207 ip-10-0-135-205 systemd[1]: Starting Kubernetes Kubelet...
Oct 30 21:16:45.534602 ip-10-0-135-205 kubenswrapper[4943]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:16:45.534602 ip-10-0-135-205 kubenswrapper[4943]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 30 21:16:45.534602 ip-10-0-135-205 kubenswrapper[4943]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:16:45.534602 ip-10-0-135-205 kubenswrapper[4943]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 30 21:16:45.536691 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536614    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.536691 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536690    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.536691 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536694    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536697    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536700    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536703    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536705    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536708    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536711    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536714    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536717    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536720    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536723    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536725    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536728    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536731    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536734    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536736    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536739    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536742    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536745    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536747    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.536787 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536750    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536753    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536756    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536758    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536761    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536771    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536774    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536776    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536779    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536782    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536785    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536787    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536790    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536793    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536795    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536799    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536801    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536804    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536807    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536810    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.537260 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536812    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536815    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536818    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536821    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536824    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536827    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536830    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536833    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536836    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536839    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536841    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536844    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536847    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536852    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536855    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536858    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536860    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536863    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536866    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.537745 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536871    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536876    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536879    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536882    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536885    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536888    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536891    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536894    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536897    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536900    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536903    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536907    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536911    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536914    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536916    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536919    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536922    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536925    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536928    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.538217 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536930    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536933    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536935    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536938    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536941    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536943    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536946    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536950    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536953    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536955    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536958    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536961    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536963    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536977    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536980    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536982    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536985    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536989    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536992    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536995    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.538692 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.536997    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537000    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537003    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537006    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537008    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537011    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537790    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537798    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537801    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537804    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537807    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537810    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537813    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537816    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537818    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537822    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537824    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537827    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537830    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.539163 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537835    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537839    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537843    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537846    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537849    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537853    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537857    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537861    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537863    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537866    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537869    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537873    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537875    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537878    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537881    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537884    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537886    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537889    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537892    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.539662 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537894    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537897    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537900    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537903    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537906    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537908    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537911    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537913    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537916    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537919    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537922    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537924    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537927    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537930    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537932    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537935    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537937    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537940    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537942    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.540121 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537945    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537948    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537954    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537957    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537962    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537965    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537968    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537971    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537974    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537976    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537979    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537982    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537985    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537988    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537990    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537993    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537996    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.537998    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538001    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538004    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.540591 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538006    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538009    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538012    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538014    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538017    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538019    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538022    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538025    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538027    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538030    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538032    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538035    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538037    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538040    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538042    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538051    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538056    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538058    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538061    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538064    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.541065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538066    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538069    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538072    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538075    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538077    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538080    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538083    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538085    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538088    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538099    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538102    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538105    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538108    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538110    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538113    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538628    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538635    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538639    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538641    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538644    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.541562 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538647    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538651    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538654    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538658    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538660    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538663    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538666    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538669    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538673    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538676    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538679    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538681    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538684    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538689    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538692    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538695    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538697    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538700    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538703    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538706    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.542038 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538709    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538711    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538714    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538717    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538720    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538722    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538725    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538728    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538730    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538733    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538736    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538738    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538741    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538743    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538746    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538749    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538752    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538754    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538757    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538759    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.542679 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538763    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538766    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538769    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538771    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538774    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538778    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538781    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538784    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538786    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538789    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538791    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538794    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538796    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538799    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538802    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538806    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538809    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538812    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538815    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.543468 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538818    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538820    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538823    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538825    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538828    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538830    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538833    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538836    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538838    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538841    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538843    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538846    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538848    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538851    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538854    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538858    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538861    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538863    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538867    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.544065 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538869    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538872    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538875    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538877    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538880    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538883    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538885    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538888    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538891    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538893    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538896    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538898    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538901    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538904    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538906    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538909    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538911    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538914    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538917    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.544537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538919    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538922    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538924    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.538927    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539017    4943 flags.go:64] FLAG: --address="0.0.0.0"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539024    4943 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539030    4943 flags.go:64] FLAG: --anonymous-auth="true"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539034    4943 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539039    4943 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539044    4943 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539048    4943 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539052    4943 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539057    4943 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539060    4943 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539064    4943 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539067    4943 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539070    4943 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539073    4943 flags.go:64] FLAG: --cgroup-root=""
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539076    4943 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539080    4943 flags.go:64] FLAG: --client-ca-file=""
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539083    4943 flags.go:64] FLAG: --cloud-provider="external"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539086    4943 flags.go:64] FLAG: --cluster-dns="[]"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539090    4943 flags.go:64] FLAG: --cluster-domain=""
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539093    4943 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 30 21:16:45.545049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539096    4943 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539100    4943 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539103    4943 flags.go:64] FLAG: --container-log-max-files="5"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539107    4943 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539110    4943 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539113    4943 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539117    4943 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539120    4943 flags.go:64] FLAG: --contention-profiling="false"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539123    4943 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539126    4943 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539129    4943 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539132    4943 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539137    4943 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539140    4943 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539143    4943 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539146    4943 flags.go:64] FLAG: --enable-load-reader="false"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539165    4943 flags.go:64] FLAG: --enable-server="true"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539169    4943 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539174    4943 flags.go:64] FLAG: --event-burst="100"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539178    4943 flags.go:64] FLAG: --event-qps="50"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539183    4943 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539186    4943 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539189    4943 flags.go:64] FLAG: --eviction-hard=""
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539193    4943 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 30 21:16:45.545661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539196    4943 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539199    4943 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539202    4943 flags.go:64] FLAG: --eviction-soft=""
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539206    4943 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539209    4943 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539212    4943 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539215    4943 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539218    4943 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539221    4943 flags.go:64] FLAG: --fail-swap-on="true"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539224    4943 flags.go:64] FLAG: --feature-gates=""
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539228    4943 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539231    4943 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539235    4943 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539238    4943 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539241    4943 flags.go:64] FLAG: --healthz-port="10248"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539244    4943 flags.go:64] FLAG: --help="false"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539247    4943 flags.go:64] FLAG: --hostname-override="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539251    4943 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539254    4943 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539257    4943 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539262    4943 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539266    4943 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539269    4943 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 30 21:16:45.546277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539272    4943 flags.go:64] FLAG: --image-service-endpoint=""
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539275    4943 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539278    4943 flags.go:64] FLAG: --kube-api-burst="100"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539281    4943 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539285    4943 flags.go:64] FLAG: --kube-api-qps="50"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539289    4943 flags.go:64] FLAG: --kube-reserved=""
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539292    4943 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539295    4943 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539298    4943 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539301    4943 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539304    4943 flags.go:64] FLAG: --lock-file=""
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539307    4943 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539310    4943 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539313    4943 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539319    4943 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539321    4943 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539325    4943 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539328    4943 flags.go:64] FLAG: --logging-format="text"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539331    4943 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539334    4943 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539337    4943 flags.go:64] FLAG: --manifest-url=""
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539341    4943 flags.go:64] FLAG: --manifest-url-header=""
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539345    4943 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539348    4943 flags.go:64] FLAG: --max-open-files="1000000"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539353    4943 flags.go:64] FLAG: --max-pods="110"
Oct 30 21:16:45.546890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539356    4943 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539359    4943 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539362    4943 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539365    4943 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539371    4943 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539374    4943 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539377    4943 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539383    4943 flags.go:64] FLAG: --node-status-max-images="50"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539387    4943 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539390    4943 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539393    4943 flags.go:64] FLAG: --pod-cidr=""
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539396    4943 flags.go:64] FLAG: --pod-manifest-path=""
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539401    4943 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539405    4943 flags.go:64] FLAG: --pods-per-core="0"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539408    4943 flags.go:64] FLAG: --port="10250"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539411    4943 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539414    4943 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-01419f90c91d384b9"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539417    4943 flags.go:64] FLAG: --qos-reserved=""
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539420    4943 flags.go:64] FLAG: --read-only-port="10255"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539423    4943 flags.go:64] FLAG: --register-node="true"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539426    4943 flags.go:64] FLAG: --register-with-taints=""
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539430    4943 flags.go:64] FLAG: --registry-burst="10"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539433    4943 flags.go:64] FLAG: --registry-qps="5"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539436    4943 flags.go:64] FLAG: --reserved-cpus=""
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539439    4943 flags.go:64] FLAG: --reserved-memory=""
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539443    4943 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 30 21:16:45.547489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539446    4943 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539449    4943 flags.go:64] FLAG: --rotate-certificates="false"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539452    4943 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539455    4943 flags.go:64] FLAG: --runonce="false"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539458    4943 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539461    4943 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539464    4943 flags.go:64] FLAG: --seccomp-default="false"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539467    4943 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539470    4943 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539473    4943 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539478    4943 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539481    4943 flags.go:64] FLAG: --storage-driver-password="root"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539484    4943 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539488    4943 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539491    4943 flags.go:64] FLAG: --storage-driver-user="root"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539494    4943 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539497    4943 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539500    4943 flags.go:64] FLAG: --system-cgroups=""
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539504    4943 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539510    4943 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539513    4943 flags.go:64] FLAG: --tls-cert-file=""
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539516    4943 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539520    4943 flags.go:64] FLAG: --tls-min-version=""
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539523    4943 flags.go:64] FLAG: --tls-private-key-file=""
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539526    4943 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 30 21:16:45.548116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539529    4943 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539532    4943 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539536    4943 flags.go:64] FLAG: --v="2"
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539540    4943 flags.go:64] FLAG: --version="false"
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539549    4943 flags.go:64] FLAG: --vmodule=""
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539569    4943 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.539575    4943 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539726    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539730    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539734    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539738    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539742    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539745    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539748    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539751    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539753    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539756    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539761    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539763    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539766    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.548719 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539769    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539771    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539774    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539777    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539779    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539783    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539786    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539789    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539792    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539794    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539797    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539800    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539802    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539805    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539807    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539810    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539813    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539815    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539818    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.549216 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539821    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539823    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539826    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539828    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539831    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539834    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539837    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539839    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539842    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539844    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539849    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539852    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539854    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539857    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539859    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539862    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539865    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539868    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539870    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539873    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.549826 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539875    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539879    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539882    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539885    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539887    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539890    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539893    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539895    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539898    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539900    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539903    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539906    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539909    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539912    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539914    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539917    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539919    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539922    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539925    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539928    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.550433 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539931    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539933    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539937    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539940    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539943    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539945    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539948    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539951    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539954    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539956    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539959    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539962    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539964    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539967    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539970    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539973    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539976    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539978    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539981    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539983    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.551039 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539986    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539989    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539991    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539994    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.539998    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540002    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540005    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540008    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540011    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540013    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540016    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540019    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540021    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540024    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.540051    4943 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:16:45.551544 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540084    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540088    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540091    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540094    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540097    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540099    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540102    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540104    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540107    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540110    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540113    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540115    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540119    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540122    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540125    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540127    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540131    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540133    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540136    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540139    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.551973 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540141    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540144    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540149    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540152    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540155    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540157    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540160    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540163    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540165    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540168    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540171    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540173    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540178    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540180    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540183    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540186    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540188    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540191    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540193    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540196    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.552456 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540199    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540203    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540205    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540208    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540210    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540214    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540216    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540219    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540221    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540224    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540227    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540230    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540232    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540235    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540239    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540241    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540244    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540247    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540249    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540252    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.553078 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540255    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540257    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540260    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540262    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540266    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540270    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540275    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540278    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540281    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540284    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540286    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540289    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540292    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540294    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540297    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540299    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540302    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540305    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.553670 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540309    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540313    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540316    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540319    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540322    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540324    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540327    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540330    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540334    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540337    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540339    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540342    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540344    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540347    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540350    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540353    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540356    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540359    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540363    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.554113 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540365    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540368    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540371    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540374    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540376    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540379    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540381    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540384    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.540386    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.544974    4943 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.544991    4943 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.545006    4943 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.545010    4943 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545082    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545087    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545091    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545095    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545099    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545103    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.554671 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545106    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545109    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545112    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545114    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545117    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545121    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545123    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545126    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545129    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545133    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545136    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545138    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545141    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545144    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545146    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545149    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545152    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545155    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545157    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545160    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.555136 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545163    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545165    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545168    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545171    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545174    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545177    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545179    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545182    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545185    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545188    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545191    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545194    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545197    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545200    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545202    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545205    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545207    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545210    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545213    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.555890 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545216    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545219    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545222    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545225    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545227    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545230    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545233    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545235    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545238    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545240    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545243    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545246    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545248    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545251    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545254    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545256    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545259    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545262    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545265    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545267    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.556627 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545270    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545273    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545276    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545279    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545282    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545284    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545287    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545290    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545292    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545295    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545298    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545301    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545303    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545306    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545309    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545312    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545314    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545317    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545320    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545322    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.557135 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545325    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545328    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545330    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545333    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545335    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545338    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545341    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545343    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545346    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545349    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545353    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545357    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545361    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545365    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545368    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545371    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545374    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545376    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545379    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.557624 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545381    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545384    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.545412    4943 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545590    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545596    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545599    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545602    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545605    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545609    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545611    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545614    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545617    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545620    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545622    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545625    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545628    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.558073 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545630    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545633    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545636    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545638    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545641    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545644    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545646    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545649    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545652    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545655    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545658    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545661    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545663    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545666    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545669    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545672    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545674    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545677    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545680    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.558459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545683    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545685    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545688    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545691    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545693    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545696    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545699    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545701    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545704    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545707    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545709    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545712    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545714    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545717    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545719    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545722    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545725    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545727    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545730    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545733    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.559046 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545735    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545738    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545741    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545743    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545746    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545749    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545751    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545754    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545757    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545760    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545762    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545765    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545767    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545770    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545773    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545776    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545778    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545781    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545783    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545787    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.559672 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545789    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545792    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545795    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545797    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545801    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545805    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545808    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545811    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545813    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545819    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545822    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545824    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545827    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545829    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545832    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545835    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545838    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545840    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545843    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.560337 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545846    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545848    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545851    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545854    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545856    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545859    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545861    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545864    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545867    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545869    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545872    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545874    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545878    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545883    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545886    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.545909    4943 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 30 21:16:45.560989 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545940    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545944    4943 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545947    4943 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545950    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545953    4943 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545956    4943 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545960    4943 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545963    4943 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545966    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545968    4943 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545971    4943 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545973    4943 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545978    4943 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545982    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545985    4943 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545987    4943 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545990    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545993    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545996    4943 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 30 21:16:45.561563 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.545998    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546001    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546004    4943 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546006    4943 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546009    4943 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546011    4943 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546014    4943 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546017    4943 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546019    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546022    4943 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546024    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546027    4943 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546030    4943 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546033    4943 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546035    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546038    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546040    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546043    4943 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546046    4943 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 30 21:16:45.562262 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546050    4943 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546053    4943 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546055    4943 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546058    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546060    4943 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546063    4943 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546066    4943 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546068    4943 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546071    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546074    4943 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546077    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546079    4943 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546082    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546085    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546087    4943 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546100    4943 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546104    4943 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546107    4943 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546109    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546112    4943 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 30 21:16:45.562823 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546115    4943 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546117    4943 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546120    4943 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546122    4943 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546125    4943 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546129    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546132    4943 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546134    4943 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546137    4943 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546140    4943 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546142    4943 feature_gate.go:386] unrecognized feature gate: Example2
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546145    4943 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546150    4943 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546153    4943 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546155    4943 feature_gate.go:386] unrecognized feature gate: Example
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546158    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546160    4943 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546163    4943 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546166    4943 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546168    4943 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 30 21:16:45.563521 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546171    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546173    4943 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546176    4943 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546179    4943 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546181    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546184    4943 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546186    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546189    4943 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546191    4943 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546198    4943 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546200    4943 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546203    4943 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546206    4943 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546210    4943 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546213    4943 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546217    4943 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546220    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546223    4943 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546226    4943 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 30 21:16:45.564093 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546230    4943 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546233    4943 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546235    4943 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546238    4943 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546241    4943 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546245    4943 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546248    4943 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546251    4943 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:45.546253    4943 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.546307    4943 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.547260    4943 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.547316    4943 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.547493    4943 server.go:1014] "Starting client certificate rotation"
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.547651    4943 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.547703    4943 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-29 21:11:04 +0000 UTC" deadline="2028-05-24 06:12:12.914173751 +0000 UTC"
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.547748    4943 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13712h55m27.366428203s"
Oct 30 21:16:45.564611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.548014    4943 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:16:45.565006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.549055    4943 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 30 21:16:45.565006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.550249    4943 log.go:25] "Validated CRI v1 runtime API"
Oct 30 21:16:45.565006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.552251    4943 log.go:25] "Validated CRI v1 image API"
Oct 30 21:16:45.565006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.552979    4943 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 30 21:16:45.565006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.554782    4943 fs.go:135] Filesystem UUIDs: map[66b90b66-65b6-4c77-9bff-21775ac53be8:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c3480384-a9a3-489a-94fa-c06047de1be5:/dev/nvme0n1p3]
Oct 30 21:16:45.565217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.554804    4943 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0a0d093969d4f15a00a1359a0d2a488c6e6cd3c01ba9f99b2551aae6ad98e9c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0a0d093969d4f15a00a1359a0d2a488c6e6cd3c01ba9f99b2551aae6ad98e9c2/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/20dfa61b24f7e9b76ea64b8fb187e9474b5ff39fb8732a40bb87e48b86561ebe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/20dfa61b24f7e9b76ea64b8fb187e9474b5ff39fb8732a40bb87e48b86561ebe/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/31ad0b621c6638947a3501f5343d8af38486e1f0ed193cdff179aac8e807ae36/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/31ad0b621c6638947a3501f5343d8af38486e1f0ed193cdff179aac8e807ae36/userdata/shm major:0 minor:289 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3241f2fe1505e9d0325ea84c7b65817234b6245596b0cb5020bd4359ed2e5aef/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3241f2fe1505e9d0325ea84c7b65817234b6245596b0cb5020bd4359ed2e5aef/userdata/shm major:0 minor:73 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/33819f234d5b55176affe85ef9401d6a97e21cee893207e43c592eb329e3bf23/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/33819f234d5b55176affe85ef9401d6a97e21cee893207e43c592eb329e3bf23/userdata/shm major:0 minor:81 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/34f31269cd9f6e5178311a764f7f2a004bb08d9153dddc5dba273ff020ed776f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/34f31269cd9f6e5178311a764f7f2a004bb08d9153dddc5dba273ff020ed776f/userdata/shm major:0 minor:288 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4283286ee54d92516f72572bf9aee28cbca1b875096a46f19a02f14988dc7683/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4283286ee54d92516f72572bf9aee28cbca1b875096a46f19a02f14988dc7683/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/68e423f5f2ce32b6d539fb5d584f3a74b24392e74ba7953182e3533ef80856bd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/68e423f5f2ce32b6d539fb5d584f3a74b24392e74ba7953182e3533ef80856bd/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/759f5c46cce4d846674af915abf6485a72bfe352813d1e8e8bfcc853b97dad7b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/759f5c46cce4d846674af915abf6485a72bfe352813d1e8e8bfcc853b97dad7b/userdata/shm major:0 minor:217 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0/userdata/shm major:0 minor:61 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/77fdd5229326713d9ce865c82f87a54b1f20a802b8dc93b3f5351b7fc7d56863/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/77fdd5229326713d9ce865c82f87a54b1f20a802b8dc93b3f5351b7fc7d56863/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/93ba31de8c166b550af84dab18811b5f667b0970e362facba25fed0b97de217d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/93ba31de8c166b550af84dab18811b5f667b0970e362facba25fed0b97de217d/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9a643b5224b2daaf969b6f4a3b0ee744ddeda6d379ebecef6ceabc4424cd8b0c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9a643b5224b2daaf969b6f4a3b0ee744ddeda6d379ebecef6ceabc4424cd8b0c/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a61a52c7ac4be1eb9dc8d46be5c9d3b3a8baa95d131a65a04194242637b6d1dc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a61a52c7ac4be1eb9dc8d46be5c9d3b3a8baa95d131a65a04194242637b6d1dc/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/af4a55fdd5be7578a1d7f58e4328a8915963ea71e97d06d1049aec2103976c10/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/af4a55fdd5be7578a1d7f58e4328a8915963ea71e97d06d1049aec2103976c10/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b0626a4c9787ce3d95d6fc172c900c530857639f75e60ba660963b2cd0e955a7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b0626a4c9787ce3d95d6fc172c900c530857639f75e60ba660963b2cd0e955a7/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b104c28565fdf124bbdb9ddfefa1308396014530a94f96f8a61b76c55d2fe5b0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b104c28565fdf124bbdb9ddfefa1308396014530a94f96f8a61b76c55d2fe5b0/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b2a7b5e2465c5043635c11dcdf1ae07911d082e7d0683da8df5891ff98b46608/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b2a7b5e2465c5043635c11dcdf1ae07911d082e7d0683da8df5891ff98b46608/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cbe635adbcb1a90bc4d03bdb37ee0f7b61571be8b68970cb1d320b89a1155ca0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cbe635adbcb1a90bc4d03bdb37ee0f7b61571be8b68970cb1d320b89a1155ca0/userdata/shm major:0 minor:216 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e078280fdf0bae240017539b501ab4e7ae859b35493bc9712a750a77c2811b42/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e078280fdf0bae240017539b501ab4e7ae859b35493bc9712a750a77c2811b42/userdata/shm major:0 minor:204 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f5a11661ea88cae2f87756759f6934bc89e8cf7b77b9a53e2e50a8e354b6c9aa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f5a11661ea88cae2f87756759f6934bc89e8cf7b77b9a53e2e50a8e354b6c9aa/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fa8606315b77f6cd1874296e544f69b11c4bd3d45660d6e7cdf6110c03825733/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fa8606315b77f6cd1874296e544f69b11c4bd3d45660d6e7cdf6110c03825733/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/002a295e-6631-4813-96e7-a8f9936e05b3/volumes/kubernetes.io~projected/kube-api-access-zmdt8:{mountpoint:/var/lib/kubelet/pods/002a295e-6631-4813-96e7-a8f9936e05b3/volumes/kubernetes.io~projected/kube-api-access-zmdt8 major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~projected/kube-api-access-hdjj5:{mountpoint:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~projected/kube-api-access-hdjj5 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68/volumes/kubernetes.io~projected/kube-api-access-5bsjm:{mountpoint:/var/lib/kubelet/pods/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68/volumes/kubernetes.io~projected/kube-api-access-5bsjm major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/01942c94-e80e-4d86-8b44-529875c8d589/volumes/kubernetes.io~projected/kube-api-access-j4fcs:{mountpoint:/var/lib/kubelet/pods/01942c94-e80e-4d86-8b44-529875c8d589/volumes/kubernetes.io~projected/kube-api-access-j4fcs major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/07137761-f8df-48e8-b75a-5f7852665e13/volumes/kubernetes.io~projected/kube-api-access-ckn2m:{mountpoint:/var/lib/kubelet/pods/07137761-f8df-48e8-b75a-5f7852665e13/volumes/kubernetes.io~projected/kube-api-access-ckn2m major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/093adaf9-e590-4301-b3f4-2d58afcf1398/volumes/kubernetes.io~projected/kube-api-access-4lrjf:{mountpoint:/var/lib/kubelet/pods/093adaf9-e590-4301-b3f4-2d58afcf1398/volumes/kubernetes.io~projected/kube-api-access-4lrjf major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volumes/kubernetes.io~projected/kube-api-access-vcx7l:{mountpoint:/var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volumes/kubernetes.io~projected/kube-api-access-vcx7l major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fbe6abd-8922-454f-8ded-4e154da37cbe/volumes/kubernetes.io~projected/kube-api-access-cxck9:{mountpoint:/var/lib/kubelet/pods/1fbe6abd-8922-454f-8ded-4e154da37cbe/volumes/kubernetes.io~projected/kube-api-access-cxck9 major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1fbe6abd-8922-454f-8ded-4e154da37cbe/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/1fbe6abd-8922-454f-8ded-4e154da37cbe/volumes/kubernetes.io~secret/serving-cert major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20532b77-4bbf-4b92-9321-79a2a2c55d16/volumes/kubernetes.io~projected/kube-api-access-bbv79:{mountpoint:/var/lib/kubelet/pods/20532b77-4bbf-4b92-9321-79a2a2c55d16/volumes/kubernetes.io~projected/kube-api-access-bbv79 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/20532b77-4bbf-4b92-9321-79a2a2c55d16/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/20532b77-4bbf-4b92-9321-79a2a2c55d16/volumes/kubernetes.io~secret/cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/239b6026-1bc2-4a79-ba5f-561ff6bb0570/volumes/kubernetes.io~projected/kube-api-access-85qhr:{mountpoint:/var/lib/kubelet/pods/239b6026-1bc2-4a79-ba5f-561ff6bb0570/volumes/kubernetes.io~projected/kube-api-access-85qhr major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26f80d0e-54bd-400f-9b86-7103ea34895a/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/26f80d0e-54bd-400f-9b86-7103ea34895a/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2bcb4b95-cf9f-4cd5-8628-4d716078026d/volumes/kubernetes.io~projected/kube-api-access-7xwz8:{mountpoint:/var/lib/kubelet/pods/2bcb4b95-cf9f-4cd5-8628-4d716078026d/volumes/kubernetes.io~projected/kube-api-access-7xwz8 major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2bcb4b95-cf9f-4cd5-8628-4d716078026d/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/2bcb4b95-cf9f-4cd5-8628-4d716078026d/volumes/kubernetes.io~secret/serving-cert major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2df32282-d6ce-4842-b488-880dcbb49979/volumes/kubernetes.io~projected/kube-api-access-v4w55:{mountpoint:/var/lib/kubelet/pods/2df32282-d6ce-4842-b488-880dcbb49979/volumes/kubernetes.io~projected/kube-api-access-v4w55 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2df32282-d6ce-4842-b488-880dcbb49979/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/2df32282-d6ce-4842-b488-880dcbb49979/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~projected/kube-api-access-jljp4:{mountpoint:/var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~projected/kube-api-access-jljp4 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~secret/default-certificate major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~secret/stats-auth major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~empty-dir/tmp major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~projected/kube-api-access-cbnbr:{mountpoint:/var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~projected/kube-api-access-cbnbr major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50545deb-2e88-4316-b8ea-60ffa646dfd2/volumes/kubernetes.io~projected/kube-api-access-s7rs4:{mountpoint:/var/lib/kubelet/pods/50545deb-2e88-4316-b8ea-60ffa646dfd2/volumes/kubernetes.io~projected/kube-api-access-s7rs4 major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5c962c0c-1334-4201-9a36-7e7bcc454f8d/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/5c962c0c-1334-4201-9a36-7e7bcc454f8d/volumes/kubernetes.io~secret/agent-certs major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5f138350-181a-4d19-8b9a-445e4f1327d7/volumes/kubernetes.io~projected/kube-api-access-gxgh9:{mountpoint:/var/lib/kubelet/pods/5f138350-181a-4d19-8b9a-445e4f1327d7/volumes/kubernetes.io~projected/kube-api-access-gxgh9 major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/725fdb19-6f8c-406e-b4c4-f9b2597887ba/volumes/kubernetes.io~projected/kube-api-access-b2h6f:{mountpoint:/var/lib/kubelet/pods/725fdb19-6f8c-406e-b4c4-f9b2597887ba/volumes/kubernetes.io~projected/kube-api-access-b2h6f major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c10ba3d-7759-4577-b5d6-d7da68fa9768/volumes/kubernetes.io~projected/kube-api-access-pvgmh:{mountpoint:/var/lib/kubelet/pods/7c10ba3d-7759-4577-b5d6-d7da68fa9768/volumes/kubernetes.io~projected/kube-api-access-pvgmh major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7c2b378d-932e-4e37-82f3-345110023994/volumes/kubernetes.io~projected/kube-api-access-n64xl:{mountpoint:/var/lib/kubelet/pods/7c2b378d-932e-4e37-82f3-345110023994/volumes/kubernetes.io~projected/kube-api-access-n64xl major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8947b771-89ac-46dc-9f8c-f218bdfaa7f5/volumes/kubernetes.io~projected/kube-api-access-8jg9g:{mountpoint:/var/lib/kubelet/pods/8947b771-89ac-46dc-9f8c-f218bdfaa7f5/volumes/kubernetes.io~projected/kube-api-access-8jg9g major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/94d63141-9177-4a26-be92-11125e1c5ab9/volumes/kubernetes.io~projected/kube-api-access-wq9gp:{mountpoint:/var/lib/kubelet/pods/94d63141-9177-4a26-be92-11125e1c5ab9/volumes/kubernetes.io~projected/kube-api-access-wq9gp major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~projected/kube-api-access-2rlxf:{mountpoint:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~projected/kube-api-access-2rlxf major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b9bc359e-dff6-4151-9210-553cb6cb727f/volumes/kubernetes.io~projected/kube-api-access-b7g6j:{mountpoint:/var/lib/kubelet/pods/b9bc359e-dff6-4151-9210-553cb6cb727f/volumes/kubernetes.io~projected/kube-api-access-b7g6j major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc5bcf28-7601-411c-a347-80adf8270f94/volumes/kubernetes.io~projected/kube-api-access-7qvqw:{mountpoint:/var/lib/kubelet/pods/bc5bcf28-7601-411c-a347-80adf8270f94/volumes/kubernetes.io~projected/kube-api-access-7qvqw major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bc5bcf28-7601-411c-a347-80adf8270f94/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/bc5bcf28-7601-411c-a347-80adf8270f94/volumes/kubernetes.io~secret/serving-cert major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/df00af45-5cd4-4831-be47-b11a225559c2/volumes/kubernetes.io~projected/kube-api-access-rnm8j:{mountpoint:/var/lib/kubelet/pods/df00af45-5cd4-4831-be47-b11a225559c2/volumes/kubernetes.io~projected/kube-api-access-rnm8j major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d/volumes/kubernetes.io~projected/kube-api-access-5xvpc:{mountpoint:/var/lib/kubelet/pods/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d/volumes/kubernetes.io~projected/kube-api-access-5xvpc major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f366bf9e-fcd7-4526-8370-9398ca15d07f/volumes/kubernetes.io~projected/kube-api-access-n7tmq:{mountpoint:/var/lib/kubelet/pods/f366bf9e-fcd7-4526-8370-9398ca15d07f/volumes/kubernetes.io~projected/kube-api-access-n7tmq major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f6248f5b-93ea-43c6-8a91-ab757ba777fa/volumes/kubernetes.io~projected/kube-api-access-q5b77:{mountpoint:/var/lib/kubelet/pods/f6248f5b-93ea-43c6-8a91-ab757ba777fa/volumes/kubernetes.io~projected/kube-api-access-q5b77 major:0 minor:197 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/724bf217741f8542c52a40d0d8d0c0a4174685abf5938425faee5d7fa849bcc6/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/8acc4cb0baeb7493b5b805d0495fe870e50a5ceff60ac01b2a43860acd817620/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/465760ca8cd2d11c09c9eb0333b3ad653bf0f9f0304e936bc91a0a1a8b51dacc/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/77a5944bbf7266bcc9f618d42f22f2bd54e3066dfccc2b3cd27fd09eed0c36bc/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/c224e3120d8919daef8aec3108a1aa0271c7941d0e210dea06fdf7ff50170bd7/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/120ff4f7f34b2b9343e1ad70e4c27577821171ad88316b898633f75b37156549/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/ec2d3ae4fa4ef893b0286bd8815957a310fa286835e1e5a404cd080c837f568e/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/25f0c06d4f614d16551fc6482cdd289bd1f5ac97eeb8143b517421a2a03c1433/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/744d416aa5228d08e599b98e945234bb6cd210d550a261ca265fb32f2f37aae8/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/60fbbbfb0b00c69df101d973b2e6acf7f3df491114322b26c0407a6464bb435e/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/522faa73850c657a7045540d100c3a9a59ffb82c57a9968dce5dbf02335f0937/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/909e10c32acce875bde87acde0484a01a7b50698050315187b998737613086af/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/b124d943f1e9f189f2002341cec67179ad947f41daa5060cf8732d52017449f2/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/56422e07b3b59ced6dc1d4a58e480c1120d9d5a0d27e8fedb0df185eb53622e9/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/2896414784fcbc4871533520a5e69c6005d68349ddcc9fc2a9a9e146190924cb/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/3f1916a27dad9e1d684e8798219fa18fbe7cd1f992b820418a131b89355c7a1a/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/58148d2db455c2dd6190ddad18f322ad083137db8c75e95e25bce88122c3098c/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/72a7ef405ec5d2b087b8b0d40af86674d02d40cf702fa7318b37205bed4df411/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/83965517793ccc37117c5ce4ebefc9595b00975fc6219acf60eefb07362e690c/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/ecb24f5da0f746854b74d2db877f2ab18f877eae5a69eb0d4a022ff4a9e1877e/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/b5a702c0913d95a0ffe6cda3e91450cd6aac9244a014239587469143961e4d75/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/443925a052bec0fdb580ad831b9497d47aa117a44067ba50d0597a18d18b305d/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/533afe96d2a72d7e32f26b750ed6396dcee34bef96ddd87b039c054c702d9ff3/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/cf9402babc55d0e6e4de412705684ba51791c4c0e194a72e74ca9c146aad2489/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/08318d1e7be91b32380f6ba85e1a9108c0e621c996c9ea800ca8d4802b3ebe35/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/a50f4b3f43e8fb17c86b83c8b81291a648cd324d4ac111e0b04ff910b2d37dc8/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/e5ed65a5a8350be8058f62b89724aee62e0cfc85fdf826dbefc59cfa7e32385b/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/396cccb6941e3bc5dbc25fac0e3e6f6fc09dcc5419bde06b6cd9fd050cbfedb8/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-261:{mountpoint:/var/lib/containers/storage/overlay/a8a6e3bcf73bc6f15059d2e0527b6837ab201e7795e1b5bbe8907e774ebb2499/merged major:0 minor:261 fsType:overlay blockSize:0} overlay_0-268:{mountpoint:/var/lib/containers/storage/overlay/bdb0ad84d4655a447ce7bf8df23f893fb7bdc4bba5f878b75613b6fdec70388e/merged major:0 minor:268 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/63a87ae6ad2b7be6d8f07456dbb871047ddc2e686a8329eaedf50f8a69f11555/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/6e2b8e30b24cdc7cb382055c1a55ffa80b573bd630cb0d9c48da398b80672fe0/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/a5f318da3639daf1af91b7221d5a2c768ce531bc87e8d6c0881ac70765c5abbc/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/3636238ad5bfeaac8225ab28899b57bf10a7c9360a9173f6f740407ab3c30da5/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/b7222267712277d3b9412916eda55a0be7c4316aa72d8a25b08b761d26768fef/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/4a314dd6fe4988d4903bf55dbb2968a989d53efba21451f07be01b75339524f5/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/f272bb53e313760cbb37cdf27f114159f4ad3387cf9740911712c3d2bba6a718/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/b057af15157c378cbcdb47e6248be15eda70e3e7404178dbf8d1de1aead8573b/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/6034ef8a5b90e3f9619fab868fd8f98a88a2e7188d9496c575515bef58aaff32/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/49e08f9ed25fb2687717a80701848fb5fdb919d947682fd7803ba484ddae474a/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-316:{mountpoint:/var/lib/containers/storage/overlay/798429d1005ade8b0506a6eab12213aff8a49eceb196ef97a806deb2892a2ebc/merged major:0 minor:316 fsType:overlay blockSize:0} overlay_0-327:{mountpoint:/var/lib/containers/storage/overlay/1d62761e6de22cdff59288b68c8aa6ee4547f40a909d017cecccee8c173b1ab3/merged major:0 minor:327 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/9ee10b70b3c4fe0db78e12f8699ea11a43c78e8c118c68cf7e19526e0910e8b8/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/32e99da566eaab4f7f2cd07efdf83c78eb242becb502ca89b99a7f7cae773f72/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-342:{mountpoint:/var/lib/containers/storage/overlay/db86189ec92f0ea3b183a860a960f921ff87af7f83d34b1c64642d9ba857e30b/merged major:0 minor:342 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/a3d7702496e1a705ede1426eaf620ada250bc0f8664c56d9566fc4a79ebb56ed/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-64:{mountpoint:/var/lib/containers/storage/overlay/ce85a137d1097bab85e2500579904c58ec18da23c0a44b4bab8173cfc40ed86d/merged major:0 minor:64 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/0f99e0dbd4a426f11e2f53a6c0ed3303dc63dcbd817d3ceeda54ca697f2e19fc/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/cf78eeebc739dbf7e78cc77ae219f2271454f0aad5d66bbb11fd68b4721ab055/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/19f7e430e401112bfd05d15d274584378fb5f9ab84e772d7b702eefc50cf71e8/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/331264df027f636552b940c2d4f3b7046cf664ac1b1b4a12c39b8aadf736f459/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/d8e0e2152419cb2a6549cfefff580b45d9355209930842efa8fe69663a30fe49/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/aaf7e5a9b64a152dc05f8f20ed2ba676fabee842e67aec6ddba8e2b9960de69e/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/2fe9d2ea112d0511a065ecea89129691b1d22a837cef42a23d9495c701e9bad6/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/dabb029764724927a0d73ab0643828856550bfc66334323ebae2a985923a5921/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/43cb1aa49903e4bea1e4066f378ff89c8ddda5a018b24aee24d40d9a59491503/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.562964    4943 manager.go:217] Machine: {Timestamp:2026-10-30 21:16:45.562503308 +0000 UTC m=+0.058076650 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103812 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c1efaba34e45de2e3ba90772a227e SystemUUID:ec2c1efa-ba34-e45d-e2e3-ba90772a227e BootID:6010bb15-4087-4e94-8575-e5ba89257f9f Filesystems:[{Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b9bc359e-dff6-4151-9210-553cb6cb727f/volumes/kubernetes.io~projected/kube-api-access-b7g6j DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/50545deb-2e88-4316-b8ea-60ffa646dfd2/volumes/kubernetes.io~projected/kube-api-access-s7rs4 DeviceMajor:0 DeviceMinor:232 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/01942c94-e80e-4d86-8b44-529875c8d589/volumes/kubernetes.io~projected/kube-api-access-j4fcs DeviceMajor:0 DeviceMinor:322 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/002a295e-6631-4813-96e7-a8f9936e05b3/volumes/kubernetes.io~projected/kube-api-access-zmdt8 DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-342 DeviceMajor:0 DeviceMinor:342 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1fbe6abd-8922-454f-8ded-4e154da37cbe/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:215 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0a0d093969d4f15a00a1359a0d2a488c6e6cd3c01ba9f99b2551aae6ad98e9c2/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:47 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/68e423f5f2ce32b6d539fb5d584f3a74b24392e74ba7953182e3533ef80856bd/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/af4a55fdd5be7578a1d7f58e4328a8915963ea71e97d06d1049aec2103976c10/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/759f5c46cce4d846674af915abf6485a72bfe352813d1e8e8bfcc853b97dad7b/userdata/shm DeviceMajor:0 DeviceMinor:217 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bc5bcf28-7601-411c-a347-80adf8270f94/volumes/kubernetes.io~projected/kube-api-access-7qvqw DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68/volumes/kubernetes.io~projected/kube-api-access-5bsjm DeviceMajor:0 DeviceMinor:287 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/f366bf9e-fcd7-4526-8370-9398ca15d07f/volumes/kubernetes.io~projected/kube-api-access-n7tmq DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2df32282-d6ce-4842-b488-880dcbb49979/volumes/kubernetes.io~projected/kube-api-access-v4w55 DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volumes/kubernetes.io~projected/kube-api-access-vcx7l DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/20dfa61b24f7e9b76ea64b8fb187e9474b5ff39fb8732a40bb87e48b86561ebe/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/20532b77-4bbf-4b92-9321-79a2a2c55d16/volumes/kubernetes.io~projected/kube-api-access-bbv79 DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b2a7b5e2465c5043635c11dcdf1ae07911d082e7d0683da8df5891ff98b46608/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/33819f234d5b55176affe85ef9401d6a97e21cee893207e43c592eb329e3bf23/userdata/shm DeviceMajor:0 DeviceMinor:81 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:214 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2bcb4b95-cf9f-4cd5-8628-4d716078026d/volumes/kubernetes.io~projected/kube-api-access-7xwz8 DeviceMajor:0 DeviceMinor:231 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1be33a60-7830-41ed-a8c4-28c576309568/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:50 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-64 DeviceMajor:0 DeviceMinor:64 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2bcb4b95-cf9f-4cd5-8628-4d716078026d/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/07137761-f8df-48e8-b75a-5f7852665e13/volumes/kubernetes.io~projected/kube-api-access-ckn2m DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/093adaf9-e590-4301-b3f4-2d58afcf1398/volumes/kubernetes.io~projected/kube-api-access-4lrjf DeviceMajor:0 DeviceMinor:230 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:48 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0/userdata/shm DeviceMajor:0 DeviceMinor:61 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~projected/kube-api-access-hdjj5 DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/26f80d0e-54bd-400f-9b86-7103ea34895a/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:286 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/31ad0b621c6638947a3501f5343d8af38486e1f0ed193cdff179aac8e807ae36/userdata/shm DeviceMajor:0 DeviceMinor:289 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-316 DeviceMajor:0 DeviceMinor:316 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8947b771-89ac-46dc-9f8c-f218bdfaa7f5/volumes/kubernetes.io~projected/kube-api-access-8jg9g DeviceMajor:0 DeviceMinor:52 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2df32282-d6ce-4842-b488-880dcbb49979/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5f138350-181a-4d19-8b9a-445e4f1327d7/volumes/kubernetes.io~projected/kube-api-access-gxgh9 DeviceMajor:0 DeviceMinor:233 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/239b6026-1bc2-4a79-ba5f-561ff6bb0570/volumes/kubernetes.io~projected/kube-api-access-85qhr DeviceMajor:0 DeviceMinor:53 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/7c10ba3d-7759-4577-b5d6-d7da68fa9768/volumes/kubernetes.io~projected/kube-api-access-pvgmh DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/93ba31de8c166b550af84dab18811b5f667b0970e362facba25fed0b97de217d/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4283286ee54d92516f72572bf9aee28cbca1b875096a46f19a02f14988dc7683/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/94d63141-9177-4a26-be92-11125e1c5ab9/volumes/kubernetes.io~projected/kube-api-access-wq9gp DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f6248f5b-93ea-43c6-8a91-ab757ba777fa/volumes/kubernetes.io~projected/kube-api-access-q5b77 DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7c2b378d-932e-4e37-82f3-345110023994/volumes/kubernetes.io~projected/kube-api-access-n64xl DeviceMajor:0 DeviceMinor:51 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/725fdb19-6f8c-406e-b4c4-f9b2597887ba/volumes/kubernetes.io~projected/kube-api-access-b2h6f DeviceMajor:0 DeviceMinor:54 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/77fdd5229326713d9ce865c82f87a54b1f20a802b8dc93b3f5351b7fc7d56863/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/34f31269cd9f6e5178311a764f7f2a004bb08d9153dddc5dba273ff020ed776f/userdata/shm DeviceMajor:0 DeviceMinor:288 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/volumes/kubernetes.io~projected/kube-api-access-jljp4 DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-261 DeviceMajor:0 DeviceMinor:261 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:229 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4b33cbaa-11aa-4d25-95bb-867618842766/volumes/kubernetes.io~projected/kube-api-access-cbnbr DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/20532b77-4bbf-4b92-9321-79a2a2c55d16/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a61a52c7ac4be1eb9dc8d46be5c9d3b3a8baa95d131a65a04194242637b6d1dc/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5c962c0c-1334-4201-9a36-7e7bcc454f8d/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:49 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d/volumes/kubernetes.io~projected/kube-api-access-5xvpc DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f5a11661ea88cae2f87756759f6934bc89e8cf7b77b9a53e2e50a8e354b6c9aa/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e078280fdf0bae240017539b501ab4e7ae859b35493bc9712a750a77c2811b42/userdata/shm DeviceMajor:0 DeviceMinor:204 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/bc5bcf28-7601-411c-a347-80adf8270f94/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cbe635adbcb1a90bc4d03bdb37ee0f7b61571be8b68970cb1d320b89a1155ca0/userdata/shm DeviceMajor:0 DeviceMinor:216 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes/kubernetes.io~projected/kube-api-access-2rlxf DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3241f2fe1505e9d0325ea84c7b65817234b6245596b0cb5020bd4359ed2e5aef/userdata/shm DeviceMajor:0 DeviceMinor:73 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-327 DeviceMajor:0 DeviceMinor:327 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fa8606315b77f6cd1874296e544f69b11c4bd3d45660d6e7cdf6110c03825733/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1fbe6abd-8922-454f-8ded-4e154da37cbe/volumes/kubernetes.io~projected/kube-api-access-cxck9 DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9a643b5224b2daaf969b6f4a3b0ee744ddeda6d379ebecef6ceabc4424cd8b0c/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/df00af45-5cd4-4831-be47-b11a225559c2/volumes/kubernetes.io~projected/kube-api-access-rnm8j DeviceMajor:0 DeviceMinor:329 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b104c28565fdf124bbdb9ddfefa1308396014530a94f96f8a61b76c55d2fe5b0/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-268 DeviceMajor:0 DeviceMinor:268 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b0626a4c9787ce3d95d6fc172c900c530857639f75e60ba660963b2cd0e955a7/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0a0d093969d4f15 MacAddress:46:9a:c6:aa:33:3e Speed:10000 Mtu:8901} {Name:31ad0b621c66389 MacAddress:ca:63:4c:6e:fd:8d Speed:10000 Mtu:8901} {Name:34f31269cd9f6e5 MacAddress:02:02:75:6e:05:99 Speed:10000 Mtu:8901} {Name:4283286ee54d925 MacAddress:12:33:0f:bf:06:f6 Speed:10000 Mtu:8901} {Name:759f5c46cce4d84 MacAddress:8a:78:8b:28:8e:fe Speed:10000 Mtu:8901} {Name:77fdd5229326713 MacAddress:4e:08:7c:1b:c3:d1 Speed:10000 Mtu:8901} {Name:93ba31de8c166b5 MacAddress:22:39:ce:9b:dd:66 Speed:10000 Mtu:8901} {Name:a61a52c7ac4be1e MacAddress:ae:e8:b3:fb:63:22 Speed:10000 Mtu:8901} {Name:af4a55fdd5be757 MacAddress:0e:e8:e1:47:55:81 Speed:10000 Mtu:8901} {Name:b0626a4c9787ce3 MacAddress:72:41:9e:ba:84:c0 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:75:18:7f:ff:07 Speed:0 Mtu:9001} {Name:br-int MacAddress:12:c3:a6:8a:70:e4 Speed:0 Mtu:8901} {Name:cbe635adbcb1a90 MacAddress:06:ca:59:f3:90:85 Speed:10000 Mtu:8901} {Name:e078280fdf0bae2 MacAddress:52:cc:dc:a3:8a:56 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:75:18:7f:ff:07 Speed:0 Mtu:9001} {Name:fa8606315b77f6c MacAddress:52:aa:d0:34:dd:35 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:82:89:14:b1:96:00 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:72:50:05:67:7f:66 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563320    4943 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563363    4943 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563648    4943 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563668    4943 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-205.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563811    4943 topology_manager.go:143] "Creating topology manager with none policy"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563819    4943 container_manager_linux.go:311] "Creating device plugin manager"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563829    4943 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563847    4943 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.563865    4943 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564009    4943 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564101    4943 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564134    4943 kubelet.go:493] "Attempting to sync node with API server"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564146    4943 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564157    4943 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564165    4943 kubelet.go:405] "Adding apiserver pod source"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564173    4943 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564851    4943 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.564861    4943 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:16:45.565539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.565323    4943 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 30 21:16:45.568475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568460    4943 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 30 21:16:45.568475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568476    4943 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 30 21:16:45.568608 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568597    4943 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 30 21:16:45.568786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568775    4943 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 30 21:16:45.568816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568804    4943 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 30 21:16:45.568902 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568893    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 30 21:16:45.568948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568907    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 30 21:16:45.568948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568914    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 30 21:16:45.568948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568919    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 30 21:16:45.568948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568925    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 30 21:16:45.568948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568931    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 30 21:16:45.568948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568936    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 30 21:16:45.568948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568946    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 30 21:16:45.569161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568955    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 30 21:16:45.569161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568961    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 30 21:16:45.569161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568975    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 30 21:16:45.569161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.568984    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 30 21:16:45.569161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.569009    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 30 21:16:45.569161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.569017    4943 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 30 21:16:45.573677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.572725    4943 server.go:1263] "Started kubelet"
Oct 30 21:16:45.573677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.573357    4943 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 30 21:16:45.573247 ip-10-0-135-205 systemd[1]: Started Kubernetes Kubelet.
Oct 30 21:16:45.574089 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.573668    4943 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 30 21:16:45.574089 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.573741    4943 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 30 21:16:45.574089 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.574076    4943 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 30 21:16:45.575590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.575573    4943 server.go:317] "Adding debug handlers to kubelet server"
Oct 30 21:16:45.577826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.577803    4943 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 30 21:16:45.577826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.577820    4943 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 30 21:16:45.578007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.577977    4943 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-29 21:11:05 +0000 UTC" deadline="2028-06-10 18:43:57.760539495 +0000 UTC"
Oct 30 21:16:45.578084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.577998    4943 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14133h27m12.182544308s"
Oct 30 21:16:45.578084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.578045    4943 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 30 21:16:45.578084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.578052    4943 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 30 21:16:45.578231 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.578214    4943 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 30 21:16:45.578904 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.578818    4943 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-205.us-west-1.compute.internal\" not found"
Oct 30 21:16:45.581167 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581131    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2df32282-d6ce-4842-b488-880dcbb49979" volumeName="kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-trusted-ca-bundle" seLinuxMountContext=""
Oct 30 21:16:45.581263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581173    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="725fdb19-6f8c-406e-b4c4-f9b2597887ba" volumeName="kubernetes.io/projected/725fdb19-6f8c-406e-b4c4-f9b2597887ba-kube-api-access-b2h6f" seLinuxMountContext=""
Oct 30 21:16:45.581263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581190    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8947b771-89ac-46dc-9f8c-f218bdfaa7f5" volumeName="kubernetes.io/projected/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-kube-api-access-8jg9g" seLinuxMountContext=""
Oct 30 21:16:45.581263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581206    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94d63141-9177-4a26-be92-11125e1c5ab9" volumeName="kubernetes.io/projected/94d63141-9177-4a26-be92-11125e1c5ab9-kube-api-access-wq9gp" seLinuxMountContext=""
Oct 30 21:16:45.581263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581222    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00d37d93-ae84-4f68-a6a7-f0c02045169b" volumeName="kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca" seLinuxMountContext=""
Oct 30 21:16:45.581263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581238    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07137761-f8df-48e8-b75a-5f7852665e13" volumeName="kubernetes.io/configmap/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-config" seLinuxMountContext=""
Oct 30 21:16:45.581263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581253    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fbe6abd-8922-454f-8ded-4e154da37cbe" volumeName="kubernetes.io/projected/1fbe6abd-8922-454f-8ded-4e154da37cbe-kube-api-access-cxck9" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581272    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f6248f5b-93ea-43c6-8a91-ab757ba777fa" volumeName="kubernetes.io/projected/f6248f5b-93ea-43c6-8a91-ab757ba777fa-kube-api-access-q5b77" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581292    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="239b6026-1bc2-4a79-ba5f-561ff6bb0570" volumeName="kubernetes.io/configmap/239b6026-1bc2-4a79-ba5f-561ff6bb0570-iptables-alerter-script" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581315    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="239b6026-1bc2-4a79-ba5f-561ff6bb0570" volumeName="kubernetes.io/projected/239b6026-1bc2-4a79-ba5f-561ff6bb0570-kube-api-access-85qhr" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581334    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f138350-181a-4d19-8b9a-445e4f1327d7" volumeName="kubernetes.io/projected/5f138350-181a-4d19-8b9a-445e4f1327d7-kube-api-access-gxgh9" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581349    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00d37d93-ae84-4f68-a6a7-f0c02045169b" volumeName="kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581360    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01942c94-e80e-4d86-8b44-529875c8d589" volumeName="kubernetes.io/empty-dir/01942c94-e80e-4d86-8b44-529875c8d589-data-volume" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581373    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1be33a60-7830-41ed-a8c4-28c576309568" volumeName="kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-env-overrides" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581389    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bcb4b95-cf9f-4cd5-8628-4d716078026d" volumeName="kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-trusted-ca" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581400    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c962c0c-1334-4201-9a36-7e7bcc454f8d" volumeName="kubernetes.io/configmap/5c962c0c-1334-4201-9a36-7e7bcc454f8d-konnectivity-ca" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581413    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4707941-37b8-49cf-bc81-71a49d4ba37e" volumeName="kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581425    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4707941-37b8-49cf-bc81-71a49d4ba37e" volumeName="kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581437    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc5bcf28-7601-411c-a347-80adf8270f94" volumeName="kubernetes.io/projected/bc5bcf28-7601-411c-a347-80adf8270f94-kube-api-access-7qvqw" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581448    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="093adaf9-e590-4301-b3f4-2d58afcf1398" volumeName="kubernetes.io/projected/093adaf9-e590-4301-b3f4-2d58afcf1398-kube-api-access-4lrjf" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581459    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1be33a60-7830-41ed-a8c4-28c576309568" volumeName="kubernetes.io/projected/1be33a60-7830-41ed-a8c4-28c576309568-kube-api-access-vcx7l" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581471    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8a1d8929-5e86-41ec-9298-26531344f8ee" volumeName="kubernetes.io/configmap/8a1d8929-5e86-41ec-9298-26531344f8ee-nginx-conf" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581484    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7ef1df8-7bdf-42c3-9934-ba7929ffa72d" volumeName="kubernetes.io/configmap/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-serviceca" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581496    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00d37d93-ae84-4f68-a6a7-f0c02045169b" volumeName="kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581509    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bcb4b95-cf9f-4cd5-8628-4d716078026d" volumeName="kubernetes.io/secret/2bcb4b95-cf9f-4cd5-8628-4d716078026d-serving-cert" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581521    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2df32282-d6ce-4842-b488-880dcbb49979" volumeName="kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-snapshots" seLinuxMountContext=""
Oct 30 21:16:45.581543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581544    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c10ba3d-7759-4577-b5d6-d7da68fa9768" volumeName="kubernetes.io/projected/7c10ba3d-7759-4577-b5d6-d7da68fa9768-kube-api-access-pvgmh" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581578    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f366bf9e-fcd7-4526-8370-9398ca15d07f" volumeName="kubernetes.io/empty-dir/f366bf9e-fcd7-4526-8370-9398ca15d07f-tmp-dir" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581597    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1be33a60-7830-41ed-a8c4-28c576309568" volumeName="kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-script-lib" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581610    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2df32282-d6ce-4842-b488-880dcbb49979" volumeName="kubernetes.io/secret/2df32282-d6ce-4842-b488-880dcbb49979-serving-cert" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581621    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="43aedfd0-4a10-4c6e-8ff4-c79f457d1aab" volumeName="kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-default-certificate" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581632    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f366bf9e-fcd7-4526-8370-9398ca15d07f" volumeName="kubernetes.io/projected/f366bf9e-fcd7-4526-8370-9398ca15d07f-kube-api-access-n7tmq" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581644    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00d37d93-ae84-4f68-a6a7-f0c02045169b" volumeName="kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581656    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1be33a60-7830-41ed-a8c4-28c576309568" volumeName="kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-config" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581668    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bcb4b95-cf9f-4cd5-8628-4d716078026d" volumeName="kubernetes.io/projected/2bcb4b95-cf9f-4cd5-8628-4d716078026d-kube-api-access-7xwz8" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581680    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2df32282-d6ce-4842-b488-880dcbb49979" volumeName="kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-service-ca-bundle" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581692    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="43aedfd0-4a10-4c6e-8ff4-c79f457d1aab" volumeName="kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-stats-auth" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581704    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b33cbaa-11aa-4d25-95bb-867618842766" volumeName="kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-tmp" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581715    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94d63141-9177-4a26-be92-11125e1c5ab9" volumeName="kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581727    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4707941-37b8-49cf-bc81-71a49d4ba37e" volumeName="kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581739    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc5bcf28-7601-411c-a347-80adf8270f94" volumeName="kubernetes.io/secret/bc5bcf28-7601-411c-a347-80adf8270f94-serving-cert" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581751    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68" volumeName="kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581763    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="07137761-f8df-48e8-b75a-5f7852665e13" volumeName="kubernetes.io/projected/07137761-f8df-48e8-b75a-5f7852665e13-kube-api-access-ckn2m" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581777    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7c2b378d-932e-4e37-82f3-345110023994" volumeName="kubernetes.io/projected/7c2b378d-932e-4e37-82f3-345110023994-kube-api-access-n64xl" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581789    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4707941-37b8-49cf-bc81-71a49d4ba37e" volumeName="kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581801    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="002a295e-6631-4813-96e7-a8f9936e05b3" volumeName="kubernetes.io/empty-dir/002a295e-6631-4813-96e7-a8f9936e05b3-tmp-dir" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581842    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00d37d93-ae84-4f68-a6a7-f0c02045169b" volumeName="kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581859    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b33cbaa-11aa-4d25-95bb-867618842766" volumeName="kubernetes.io/projected/4b33cbaa-11aa-4d25-95bb-867618842766-kube-api-access-cbnbr" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581874    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="725fdb19-6f8c-406e-b4c4-f9b2597887ba" volumeName="kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581887    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94d63141-9177-4a26-be92-11125e1c5ab9" volumeName="kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581900    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="df00af45-5cd4-4831-be47-b11a225559c2" volumeName="kubernetes.io/projected/df00af45-5cd4-4831-be47-b11a225559c2-kube-api-access-rnm8j" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581912    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00d37d93-ae84-4f68-a6a7-f0c02045169b" volumeName="kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581925    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2bcb4b95-cf9f-4cd5-8628-4d716078026d" volumeName="kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-config" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581938    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="43aedfd0-4a10-4c6e-8ff4-c79f457d1aab" volumeName="kubernetes.io/projected/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-kube-api-access-jljp4" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581950    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c962c0c-1334-4201-9a36-7e7bcc454f8d" volumeName="kubernetes.io/secret/5c962c0c-1334-4201-9a36-7e7bcc454f8d-agent-certs" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581962    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="01942c94-e80e-4d86-8b44-529875c8d589" volumeName="kubernetes.io/projected/01942c94-e80e-4d86-8b44-529875c8d589-kube-api-access-j4fcs" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581982    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fbe6abd-8922-454f-8ded-4e154da37cbe" volumeName="kubernetes.io/configmap/1fbe6abd-8922-454f-8ded-4e154da37cbe-config" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.581994    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1fbe6abd-8922-454f-8ded-4e154da37cbe" volumeName="kubernetes.io/secret/1fbe6abd-8922-454f-8ded-4e154da37cbe-serving-cert" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582007    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2df32282-d6ce-4842-b488-880dcbb49979" volumeName="kubernetes.io/projected/2df32282-d6ce-4842-b488-880dcbb49979-kube-api-access-v4w55" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582019    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="94d63141-9177-4a26-be92-11125e1c5ab9" volumeName="kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-binary-copy" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582032    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e7ef1df8-7bdf-42c3-9934-ba7929ffa72d" volumeName="kubernetes.io/projected/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-kube-api-access-5xvpc" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582045    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="002a295e-6631-4813-96e7-a8f9936e05b3" volumeName="kubernetes.io/configmap/002a295e-6631-4813-96e7-a8f9936e05b3-config-volume" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582057    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="00d37d93-ae84-4f68-a6a7-f0c02045169b" volumeName="kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582077    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26f80d0e-54bd-400f-9b86-7103ea34895a" volumeName="kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582097    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2df32282-d6ce-4842-b488-880dcbb49979" volumeName="kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-tmp" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582109    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4707941-37b8-49cf-bc81-71a49d4ba37e" volumeName="kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582123    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4707941-37b8-49cf-bc81-71a49d4ba37e" volumeName="kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582135    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b9bc359e-dff6-4151-9210-553cb6cb727f" volumeName="kubernetes.io/projected/b9bc359e-dff6-4151-9210-553cb6cb727f-kube-api-access-b7g6j" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582147    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bc5bcf28-7601-411c-a347-80adf8270f94" volumeName="kubernetes.io/configmap/bc5bcf28-7601-411c-a347-80adf8270f94-config" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582159    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1be33a60-7830-41ed-a8c4-28c576309568" volumeName="kubernetes.io/secret/1be33a60-7830-41ed-a8c4-28c576309568-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582180    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20532b77-4bbf-4b92-9321-79a2a2c55d16" volumeName="kubernetes.io/projected/20532b77-4bbf-4b92-9321-79a2a2c55d16-kube-api-access-bbv79" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582192    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="20532b77-4bbf-4b92-9321-79a2a2c55d16" volumeName="kubernetes.io/secret/20532b77-4bbf-4b92-9321-79a2a2c55d16-cert" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582205    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4b33cbaa-11aa-4d25-95bb-867618842766" volumeName="kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-etc-tuned" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582216    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="725fdb19-6f8c-406e-b4c4-f9b2597887ba" volumeName="kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-daemon-config" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582228    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4707941-37b8-49cf-bc81-71a49d4ba37e" volumeName="kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582241    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="002a295e-6631-4813-96e7-a8f9936e05b3" volumeName="kubernetes.io/projected/002a295e-6631-4813-96e7-a8f9936e05b3-kube-api-access-zmdt8" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582253    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50545deb-2e88-4316-b8ea-60ffa646dfd2" volumeName="kubernetes.io/projected/50545deb-2e88-4316-b8ea-60ffa646dfd2-kube-api-access-s7rs4" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582265    4943 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5f138350-181a-4d19-8b9a-445e4f1327d7" volumeName="kubernetes.io/configmap/5f138350-181a-4d19-8b9a-445e4f1327d7-telemetry-config" seLinuxMountContext=""
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582276    4943 reconstruct.go:97] "Volume reconstruction finished"
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582284    4943 reconciler.go:29] "Reconciler: start to sync state"
Oct 30 21:16:45.582445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.579421    4943 factory.go:55] Registering systemd factory
Oct 30 21:16:45.584366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582456    4943 factory.go:223] Registration of the systemd container factory successfully
Oct 30 21:16:45.584366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.582995    4943 factory.go:153] Registering CRI-O factory
Oct 30 21:16:45.584366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.583011    4943 factory.go:223] Registration of the crio container factory successfully
Oct 30 21:16:45.584366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.583068    4943 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 30 21:16:45.584366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.583095    4943 factory.go:103] Registering Raw factory
Oct 30 21:16:45.584366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.583114    4943 manager.go:1199] Started watching for new ooms in manager
Oct 30 21:16:45.584366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.583488    4943 manager.go:319] Starting recovery of all containers
Oct 30 21:16:45.595308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.595284    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/1.log"
Oct 30 21:16:45.595599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.595578    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/1.log"
Oct 30 21:16:45.609119 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.609082    4943 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 30 21:16:45.610286 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.610266    4943 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 30 21:16:45.610286 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.610289    4943 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 30 21:16:45.610430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.610308    4943 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 30 21:16:45.610430 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.610345    4943 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 30 21:16:45.631393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.631340    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/1.log"
Oct 30 21:16:45.631393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.631370    4943 generic.go:356] "Generic (PLEG): container finished" podID="2bcb4b95-cf9f-4cd5-8628-4d716078026d" containerID="2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415" exitCode=255
Oct 30 21:16:45.640409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.640388    4943 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="5175ef9dde143eeca9b191ea3c97f46aa9187620bcf5810dfa023db5e7be6ec1" exitCode=0
Oct 30 21:16:45.640409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.640407    4943 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="86eafbbc8811f7941b4a996d08cd533af81883f21a6242142ed3eee6af52c7cc" exitCode=0
Oct 30 21:16:45.640536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.640413    4943 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="977a3bc81eb8e1a63cddb17ad65df4b36f265dfe88bd2d320f3531ac0b18271e" exitCode=0
Oct 30 21:16:45.640536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.640420    4943 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="0064f0592b2f7a84793cf3e2a34966fc3546b840cab8c3dfaf46a3f37c91bea4" exitCode=0
Oct 30 21:16:45.640536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.640427    4943 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="c3a4899ba466aa8592f25be93e85f29bfdd8b63943c3d57c6ca685dae5512a61" exitCode=0
Oct 30 21:16:45.640536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.640436    4943 generic.go:356] "Generic (PLEG): container finished" podID="94d63141-9177-4a26-be92-11125e1c5ab9" containerID="c00cce93cde2ac01b0a910f4790ce980636bd1fe1f06045fd5a34d4e38b80ac3" exitCode=0
Oct 30 21:16:45.643025 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.642985    4943 generic.go:356] "Generic (PLEG): container finished" podID="a1f5ce0999b1672653e8437773a46c25" containerID="b571a0ecc59156413a6ea672907414012a8ee127d9816c602aa1b46dadb2ae42" exitCode=0
Oct 30 21:16:45.673482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.673462    4943 manager.go:324] Recovery completed
Oct 30 21:16:45.678918 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.678896    4943 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-135-205.us-west-1.compute.internal\" not found"
Oct 30 21:16:45.690820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.690801    4943 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:45.692637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.692622    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:45.692684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.692650    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:45.692684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.692661    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:45.695050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695034    4943 cpu_manager.go:226] "Starting" policy="none"
Oct 30 21:16:45.695050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695047    4943 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 30 21:16:45.695140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695058    4943 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:45.695140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695063    4943 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 30 21:16:45.695278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695265    4943 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 30 21:16:45.695308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695279    4943 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 30 21:16:45.695308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695301    4943 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 30 21:16:45.695359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695309    4943 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 30 21:16:45.695359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695317    4943 policy_none.go:50] "Start"
Oct 30 21:16:45.695359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695329    4943 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 30 21:16:45.695359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695342    4943 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 30 21:16:45.695500 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695489    4943 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 30 21:16:45.695529 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695503    4943 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 30 21:16:45.695529 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695508    4943 policy_none.go:44] "Start"
Oct 30 21:16:45.695915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695900    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:45.695964 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695925    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:45.695964 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.695935    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:45.701192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.701165    4943 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 30 21:16:45.704360 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704348    4943 manager.go:341] "Starting Device Plugin manager"
Oct 30 21:16:45.704407 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.704372    4943 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 30 21:16:45.704407 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704381    4943 server.go:87] "Starting device plugin registration server"
Oct 30 21:16:45.704700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704688    4943 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 30 21:16:45.704735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704703    4943 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 30 21:16:45.704781 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704755    4943 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 30 21:16:45.704940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704901    4943 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 30 21:16:45.704940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704947    4943 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 30 21:16:45.705061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.704955    4943 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 30 21:16:45.705135 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.705034    4943 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-30T21:16:45.704936954Z","UUID":"cc744a24-4efe-4937-b892-34e5bac906ff","Handler":null,"Name":"","Endpoint":""}
Oct 30 21:16:45.706385 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.706369    4943 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 30 21:16:45.706482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.706404    4943 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 30 21:16:45.706482 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.706432    4943 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 30 21:16:45.706482 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.706466    4943 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-205.us-west-1.compute.internal\" not found"
Oct 30 21:16:45.711087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.710435    4943 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"]
Oct 30 21:16:45.711190 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.711178    4943 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:45.712029 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.712011    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:45.712120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.712033    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:45.712120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.712048    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:45.712348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.712335    4943 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:45.712482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.712463    4943 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:45.713108 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713088    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:45.713206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713116    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:45.713206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713127    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:45.713206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713164    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:45.713206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713190    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:45.713206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713205    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:45.713429 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.713360    4943 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-205.us-west-1.compute.internal\" not found" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.713479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713447    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"a1f5ce0999b1672653e8437773a46c25","Type":"ContainerStarted","Data":"70577b3a4fb424bcfa807badab3b07a809bd09364c20412224af40d472aae5bc"}
Oct 30 21:16:45.713518 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713489    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"a1f5ce0999b1672653e8437773a46c25","Type":"ContainerDied","Data":"b571a0ecc59156413a6ea672907414012a8ee127d9816c602aa1b46dadb2ae42"}
Oct 30 21:16:45.713518 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713507    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"a1f5ce0999b1672653e8437773a46c25","Type":"ContainerStarted","Data":"77d292cfc6897fb904d8c162f486db1c31895dfc73c1c29c68adc2cd784ba4b0"}
Oct 30 21:16:45.713595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713521    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"61a83213484fa2827d610c578ff6f296","Type":"ContainerStarted","Data":"478fe7bf70fa7c91749ecdd5ec0b57fc9ae6b76eacd907238309a579c6f3576b"}
Oct 30 21:16:45.713595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713526    4943 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:45.713595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.713538    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal" event={"ID":"61a83213484fa2827d610c578ff6f296","Type":"ContainerStarted","Data":"d8ca7c96a8bf3cb965e8bc7e7fe3a835831a26cb8a0b1ada348f1ef3996b8ed5"}
Oct 30 21:16:45.714226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.714211    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:45.714308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.714234    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:45.714308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.714243    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:45.714393 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.714360    4943 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-205.us-west-1.compute.internal\" not found" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.769496 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.769468    4943 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:45.769496 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.769501    4943 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:45.769718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.769702    4943 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 30 21:16:45.770263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.770247    4943 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:45.779365 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.779349    4943 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.805517 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.805497    4943 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 30 21:16:45.806494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.806478    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Oct 30 21:16:45.806590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.806508    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Oct 30 21:16:45.806590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.806524    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeHasSufficientPID"
Oct 30 21:16:45.806590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.806584    4943 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.820294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.820274    4943 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 30 21:16:45.840776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.840757    4943 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:16:45.840858 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.840802    4943 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.840858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.840816    4943 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.869838 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.869814    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.869965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.869846    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.869965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.869867    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61a83213484fa2827d610c578ff6f296-config\") pod \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"61a83213484fa2827d610c578ff6f296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.919056 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.919029    4943 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.919175 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.919108    4943 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.919718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.919702    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeNotReady"
Oct 30 21:16:45.919785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.919737    4943 setters.go:546] "Node became not ready" node="ip-10-0-135-205.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-10-30T21:16:45Z","lastTransitionTime":"2026-10-30T21:16:45Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Oct 30 21:16:45.930188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.930162    4943 nodeinfomanager.go:471] existing CSINode "ip-10-0-135-205.us-west-1.compute.internal" is owned by different node (oldNodeID="f7d8f7ea-f3bb-4eaa-a3c9-78d0aa2088fe", newNodeID=""), cleaning up...
Oct 30 21:16:45.944084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.944063    4943 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:16:45.944171 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:45.944110    4943 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.970255 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.970230    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.970322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.970273    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.970322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.970291    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61a83213484fa2827d610c578ff6f296-config\") pod \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"61a83213484fa2827d610c578ff6f296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.970393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.970334    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.970393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.970340    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a1f5ce0999b1672653e8437773a46c25-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"a1f5ce0999b1672653e8437773a46c25\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:45.970447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:45.970403    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/61a83213484fa2827d610c578ff6f296-config\") pod \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" (UID: \"61a83213484fa2827d610c578ff6f296\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:46.564938 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.564904    4943 apiserver.go:52] "Watching apiserver"
Oct 30 21:16:46.661352 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.661329    4943 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:46.661505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.661456    4943 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:46.718474 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.718447    4943 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 30 21:16:46.719151 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.719128    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-d7kds","openshift-cluster-node-tuning-operator/tuned-4l6nm","openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9","openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5","openshift-multus/network-metrics-daemon-hstlp","kube-system/konnectivity-agent-6pzlh","openshift-network-diagnostics/network-check-target-cmvnx","openshift-image-registry/image-registry-675c47d4b7-tznvs","openshift-network-console/networking-console-plugin-86c478bb88-stjmx","openshift-dns/node-resolver-hlvrt","kube-system/kas-connection-checker-685895c7c9-mdw62","kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal","openshift-image-registry/image-registry-c9745cfc4-b9rb6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal","openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn","openshift-multus/multus-additional-cni-plugins-blmqq","openshift-console-operator/console-operator-7cd56b8dbc-2vz6h","openshift-ingress/router-default-6d7bfbd7bc-slk74","kube-system/global-pull-secret-syncer-2g9kx","openshift-image-registry/node-ca-z92xh","openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf","kube-system/kas-connection-checker-685895c7c9-spg6c","openshift-insights/insights-runtime-extractor-57nxn","openshift-dns/dns-default-7zdht","kube-system/kas-connection-checker-685895c7c9-vmw5p","openshift-multus/multus-44tnc","openshift-ingress-canary/ingress-canary-kwbfv","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd","openshift-network-operator/iptables-alerter-7jmrh","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx","openshift-ovn-kubernetes/ovnkube-node-j2ck7"]
Oct 30 21:16:46.721055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.721036    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.721810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.721790    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:46.722114 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.722089    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:46.722638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.722621    4943 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:16:46.722728 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.722674    4943 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:46.723055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.723037    4943 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 30 21:16:46.723159 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.723079    4943 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-205.us-west-1.compute.internal"
Oct 30 21:16:46.723785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.723768    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.724195 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.724180    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:46.725953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.725938    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:46.733025 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.733005    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.734127 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.734110    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.734886 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.734866    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.773350 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.773330    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.773432 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.773330    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.773501 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.773488    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 30 21:16:46.773741 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.773727    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.775241 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775215    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 30 21:16:46.775373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775242    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 30 21:16:46.775373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775286    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 30 21:16:46.775373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775358    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 30 21:16:46.775536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775494    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 30 21:16:46.775536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775521    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 30 21:16:46.775536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775550    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 30 21:16:46.775798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775621    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fxr9c\""
Oct 30 21:16:46.775798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775682    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 30 21:16:46.775927 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775912    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.775986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775928    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.775986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.775950    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.776161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776147    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.776226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776200    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 30 21:16:46.776226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776210    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 30 21:16:46.776296 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776226    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 30 21:16:46.776296 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776223    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 30 21:16:46.776487 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776473    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.776487 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776484    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 30 21:16:46.776580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776506    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 30 21:16:46.776580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776545    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.776580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.776571    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.777411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777392    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.777411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777407    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.777623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777421    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.777623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777433    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.777623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777440    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.777623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777456    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 30 21:16:46.777623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777487    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.777623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777496    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.777956 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777708    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.777956 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777776    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.777956 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777777    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 30 21:16:46.777956 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.777844    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.779985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.779971    4943 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 30 21:16:46.822677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.822631    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 30 21:16:46.828111 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828063    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 30 21:16:46.828336 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828302    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 30 21:16:46.828336 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828307    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828344    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828362    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828383    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828427    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828435    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-p2m87\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828462    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ztz2s\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828465    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 30 21:16:46.828710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828618    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-ks46b\""
Oct 30 21:16:46.829054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828854    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.829054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828865    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-5jmhs\""
Oct 30 21:16:46.829054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828910    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.829054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.828995    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 30 21:16:46.829054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829024    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 30 21:16:46.829270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829245    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.829374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829360    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 30 21:16:46.829449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829430    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 30 21:16:46.829506 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829493    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.829578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829531    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.829645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829590    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pc6p4\""
Oct 30 21:16:46.829698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829654    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p6llv\""
Oct 30 21:16:46.829745 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829715    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 30 21:16:46.829745 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829735    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 30 21:16:46.829923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829904    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 30 21:16:46.830000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829983    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.830076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830062    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.830196 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830176    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 30 21:16:46.830232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830215    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.830282 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830268    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.830351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.829887    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hrcct\""
Oct 30 21:16:46.830351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830350    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 30 21:16:46.830417 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830392    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 30 21:16:46.830417 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830415    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.830490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830416    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.830490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830428    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.830490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830268    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.830490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830438    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.830490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830444    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 30 21:16:46.830490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830472    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.830708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830519    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kknvl\""
Oct 30 21:16:46.830708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830580    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-42q2c\""
Oct 30 21:16:46.830708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830618    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-6wvjk\""
Oct 30 21:16:46.830708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830649    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 30 21:16:46.831060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.830581    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-t44zw\""
Oct 30 21:16:46.831153 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831135    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 30 21:16:46.831215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831161    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 30 21:16:46.831300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831284    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8g8v4\""
Oct 30 21:16:46.831427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831405    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 30 21:16:46.831510 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831285    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 30 21:16:46.831674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831657    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 30 21:16:46.831760 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831738    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-z7dj2\""
Oct 30 21:16:46.831832 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831758    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 30 21:16:46.831832 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.831811    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7lps2\""
Oct 30 21:16:46.832186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.832164    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-msgtv\""
Oct 30 21:16:46.832304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.832289    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 30 21:16:46.832375 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.832291    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmnhg\""
Oct 30 21:16:46.834456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.832350    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fp6d9\""
Oct 30 21:16:46.872287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.872265    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 30 21:16:46.875039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875022    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 30 21:16:46.875238 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875222    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1be33a60-7830-41ed-a8c4-28c576309568-ovn-node-metrics-cert\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.875278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875249    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.875278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875266    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.875401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875383    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.875435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875422    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-kubelet-config\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.875486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875451    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-etc-kubernetes\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.875522 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875498    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-service-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.875613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875520    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.875613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875575    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-env-overrides\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.875692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875611    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1be33a60-7830-41ed-a8c4-28c576309568-ovn-node-metrics-cert\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.875692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875658    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01942c94-e80e-4d86-8b44-529875c8d589-data-volume\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.875768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875740    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-service-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.875817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875762    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-env-overrides\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.875817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875769    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdjj5\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.875817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875787    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01942c94-e80e-4d86-8b44-529875c8d589-data-volume\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.875897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875834    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fbe6abd-8922-454f-8ded-4e154da37cbe-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:46.875951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875935    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvgmh\" (UniqueName: \"kubernetes.io/projected/7c10ba3d-7759-4577-b5d6-d7da68fa9768-kube-api-access-pvgmh\") pod \"kas-connection-checker-685895c7c9-vmw5p\" (UID: \"7c10ba3d-7759-4577-b5d6-d7da68fa9768\") " pod="kube-system/kas-connection-checker-685895c7c9-vmw5p"
Oct 30 21:16:46.876000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.875990    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.876040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876017    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1fbe6abd-8922-454f-8ded-4e154da37cbe-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:46.876112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876097    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cni-binary-copy\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.876181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876161    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-system-cni-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.876212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876200    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:46.876245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876226    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.876274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876250    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4fcs\" (UniqueName: \"kubernetes.io/projected/01942c94-e80e-4d86-8b44-529875c8d589-kube-api-access-j4fcs\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.876303 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876270    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.876303 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876294    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xvpc\" (UniqueName: \"kubernetes.io/projected/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-kube-api-access-5xvpc\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:46.876375 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876334    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnm8j\" (UniqueName: \"kubernetes.io/projected/df00af45-5cd4-4831-be47-b11a225559c2-kube-api-access-rnm8j\") pod \"migrator-66df5d496b-vj4nf\" (UID: \"df00af45-5cd4-4831-be47-b11a225559c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"
Oct 30 21:16:46.876412 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876371    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.876412 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876398    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cni-binary-copy\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.876490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876399    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xwz8\" (UniqueName: \"kubernetes.io/projected/2bcb4b95-cf9f-4cd5-8628-4d716078026d-kube-api-access-7xwz8\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.876490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876399    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:46.876490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876441    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-host\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:46.876490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876483    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df32282-d6ce-4842-b488-880dcbb49979-serving-cert\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.876642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876512    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5b77\" (UniqueName: \"kubernetes.io/projected/f6248f5b-93ea-43c6-8a91-ab757ba777fa-kube-api-access-q5b77\") pod \"kas-connection-checker-685895c7c9-mdw62\" (UID: \"f6248f5b-93ea-43c6-8a91-ab757ba777fa\") " pod="kube-system/kas-connection-checker-685895c7c9-mdw62"
Oct 30 21:16:46.876642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876537    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.876642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876583    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-bin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.876642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876602    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysconfig\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.876642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876618    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c962c0c-1334-4201-9a36-7e7bcc454f8d-konnectivity-ca\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:46.876642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876634    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2df32282-d6ce-4842-b488-880dcbb49979-serving-cert\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.876858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876639    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-config\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.876858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876705    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.876858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876754    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-serviceca\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:46.876858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876835    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-config\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.876858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876842    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26f80d0e-54bd-400f-9b86-7103ea34895a-original-pull-secret\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876874    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-multus-certs\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876892    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876899    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-tmp\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876911    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-serviceca\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876917    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-kubernetes\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876921    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5c962c0c-1334-4201-9a36-7e7bcc454f8d-konnectivity-ca\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876939    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876972    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-device-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.877006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.876991    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877028    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-tmp\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877031    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002a295e-6631-4813-96e7-a8f9936e05b3-tmp-dir\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877081    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg9g\" (UniqueName: \"kubernetes.io/projected/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-kube-api-access-8jg9g\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877111    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/002a295e-6631-4813-96e7-a8f9936e05b3-tmp-dir\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877142    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fbe6abd-8922-454f-8ded-4e154da37cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877177    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-default-certificate\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877195    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877245    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckn2m\" (UniqueName: \"kubernetes.io/projected/07137761-f8df-48e8-b75a-5f7852665e13-kube-api-access-ckn2m\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877275    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljp4\" (UniqueName: \"kubernetes.io/projected/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-kube-api-access-jljp4\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877306    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-log-socket\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.877343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877330    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cnibin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877349    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1fbe6abd-8922-454f-8ded-4e154da37cbe-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877356    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877432    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-default-certificate\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877433    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f138350-181a-4d19-8b9a-445e4f1327d7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877471    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877517    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-tmp\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877545    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n64xl\" (UniqueName: \"kubernetes.io/projected/7c2b378d-932e-4e37-82f3-345110023994-kube-api-access-n64xl\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877591    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877616    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-tmp\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877634    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-var-lib-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877669    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85qhr\" (UniqueName: \"kubernetes.io/projected/239b6026-1bc2-4a79-ba5f-561ff6bb0570-kube-api-access-85qhr\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877678    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f138350-181a-4d19-8b9a-445e4f1327d7-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877766    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5bcf28-7601-411c-a347-80adf8270f94-serving-cert\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:46.877885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877848    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-systemd-units\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877945    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-netns\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877978    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-socket-dir-parent\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.877946    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc5bcf28-7601-411c-a347-80adf8270f94-serving-cert\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878008    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7tmq\" (UniqueName: \"kubernetes.io/projected/f366bf9e-fcd7-4526-8370-9398ca15d07f-kube-api-access-n7tmq\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878034    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878126    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239b6026-1bc2-4a79-ba5f-561ff6bb0570-host-slash\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878144    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rs4\" (UniqueName: \"kubernetes.io/projected/50545deb-2e88-4316-b8ea-60ffa646dfd2-kube-api-access-s7rs4\") pod \"network-check-source-6f78d59f99-mddn5\" (UID: \"50545deb-2e88-4316-b8ea-60ffa646dfd2\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878160    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878177    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-dbus\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878195    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-daemon-config\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878334    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq9gp\" (UniqueName: \"kubernetes.io/projected/94d63141-9177-4a26-be92-11125e1c5ab9-kube-api-access-wq9gp\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878344    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df32282-d6ce-4842-b488-880dcbb49979-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878362    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878428    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878441    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-daemon-config\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878453    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-etc-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878479    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-ovn\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878521    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-config\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878533    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878542    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878584    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/002a295e-6631-4813-96e7-a8f9936e05b3-config-volume\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.878588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878601    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5bcf28-7601-411c-a347-80adf8270f94-config\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878623    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4w55\" (UniqueName: \"kubernetes.io/projected/2df32282-d6ce-4842-b488-880dcbb49979-kube-api-access-v4w55\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878663    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-var-lib-kubelet\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878682    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01942c94-e80e-4d86-8b44-529875c8d589-crio-socket\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878699    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a1d8929-5e86-41ec-9298-26531344f8ee-nginx-conf\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878707    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-config\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878718    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878739    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878790    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc5bcf28-7601-411c-a347-80adf8270f94-config\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878844    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qvqw\" (UniqueName: \"kubernetes.io/projected/bc5bcf28-7601-411c-a347-80adf8270f94-kube-api-access-7qvqw\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878867    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8a1d8929-5e86-41ec-9298-26531344f8ee-nginx-conf\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878891    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/002a295e-6631-4813-96e7-a8f9936e05b3-config-volume\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878894    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-systemd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.878972    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-trusted-ca\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879028    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879137    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-bin\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879181    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879198    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxck9\" (UniqueName: \"kubernetes.io/projected/1fbe6abd-8922-454f-8ded-4e154da37cbe-kube-api-access-cxck9\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879247    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-slash\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879345    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rlxf\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879371    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2h6f\" (UniqueName: \"kubernetes.io/projected/725fdb19-6f8c-406e-b4c4-f9b2597887ba-kube-api-access-b2h6f\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879421    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.879532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879462    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7g6j\" (UniqueName: \"kubernetes.io/projected/b9bc359e-dff6-4151-9210-553cb6cb727f-kube-api-access-b7g6j\") pod \"kas-connection-checker-685895c7c9-spg6c\" (UID: \"b9bc359e-dff6-4151-9210-553cb6cb727f\") " pod="kube-system/kas-connection-checker-685895c7c9-spg6c"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879591    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-kubelet\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879621    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2bcb4b95-cf9f-4cd5-8628-4d716078026d-trusted-ca\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879639    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcx7l\" (UniqueName: \"kubernetes.io/projected/1be33a60-7830-41ed-a8c4-28c576309568-kube-api-access-vcx7l\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879666    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcb4b95-cf9f-4cd5-8628-4d716078026d-serving-cert\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879734    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879783    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-conf-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879804    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f366bf9e-fcd7-4526-8370-9398ca15d07f-hosts-file\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879804    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2bcb4b95-cf9f-4cd5-8628-4d716078026d-serving-cert\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879838    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-stats-auth\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879855    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-conf\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879872    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbnbr\" (UniqueName: \"kubernetes.io/projected/4b33cbaa-11aa-4d25-95bb-867618842766-kube-api-access-cbnbr\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879892    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-node-log\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879910    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-system-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.879950    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880009    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-stats-auth\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880051    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-cnibin\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880072    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880088    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880118    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880146    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-modprobe-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880169    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880214    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmdt8\" (UniqueName: \"kubernetes.io/projected/002a295e-6631-4813-96e7-a8f9936e05b3-kube-api-access-zmdt8\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880236    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880259    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-script-lib\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880290    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880311    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-sys\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880347    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880382    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-k8s-cni-cncf-io\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.880447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880445    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-binary-copy\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880500    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880536    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-lib-modules\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880577    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1be33a60-7830-41ed-a8c4-28c576309568-ovnkube-script-lib\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880595    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880636    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880643    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-netd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880681    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-binary-copy\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880696    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-multus\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880759    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f366bf9e-fcd7-4526-8370-9398ca15d07f-tmp-dir\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880801    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880838    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-host\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880877    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f366bf9e-fcd7-4526-8370-9398ca15d07f-tmp-dir\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880884    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239b6026-1bc2-4a79-ba5f-561ff6bb0570-iptables-alerter-script\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.880925    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c962c0c-1334-4201-9a36-7e7bcc454f8d-agent-certs\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881193    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/239b6026-1bc2-4a79-ba5f-561ff6bb0570-iptables-alerter-script\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881232    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20532b77-4bbf-4b92-9321-79a2a2c55d16-cert\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881268    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-kubelet\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881281    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5c962c0c-1334-4201-9a36-7e7bcc454f8d-agent-certs\") pod \"konnectivity-agent-6pzlh\" (UID: \"5c962c0c-1334-4201-9a36-7e7bcc454f8d\") " pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881296    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-run\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881331    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-hostroot\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881363    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881384    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881445    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20532b77-4bbf-4b92-9321-79a2a2c55d16-cert\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881426    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881485    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-etc-tuned\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881516    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881542    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxgh9\" (UniqueName: \"kubernetes.io/projected/5f138350-181a-4d19-8b9a-445e4f1327d7-kube-api-access-gxgh9\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881583    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-snapshots\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881610    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbv79\" (UniqueName: \"kubernetes.io/projected/20532b77-4bbf-4b92-9321-79a2a2c55d16-kube-api-access-bbv79\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881615    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/94d63141-9177-4a26-be92-11125e1c5ab9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881625    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b33cbaa-11aa-4d25-95bb-867618842766-etc-tuned\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881638    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881662    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881665    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881693    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2df32282-d6ce-4842-b488-880dcbb49979-snapshots\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881714    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lrjf\" (UniqueName: \"kubernetes.io/projected/093adaf9-e590-4301-b3f4-2d58afcf1398-kube-api-access-4lrjf\") pod \"volume-data-source-validator-58c9f5f46d-fgqwn\" (UID: \"093adaf9-e590-4301-b3f4-2d58afcf1398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881766    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881777    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-netns\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881806    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.881843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.881830    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-systemd\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.890645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.890623    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:46.932343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.932319    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.936326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.936307    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bsjm\" (UniqueName: \"kubernetes.io/projected/00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68-kube-api-access-5bsjm\") pod \"network-check-target-cmvnx\" (UID: \"00eb7bfc-9f77-4129-a1c7-d3a1e8f21d68\") " pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:46.936436 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.936357    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdjj5\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.936497 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.936476    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xvpc\" (UniqueName: \"kubernetes.io/projected/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-kube-api-access-5xvpc\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:46.936571 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.936498    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5b77\" (UniqueName: \"kubernetes.io/projected/f6248f5b-93ea-43c6-8a91-ab757ba777fa-kube-api-access-q5b77\") pod \"kas-connection-checker-685895c7c9-mdw62\" (UID: \"f6248f5b-93ea-43c6-8a91-ab757ba777fa\") " pod="kube-system/kas-connection-checker-685895c7c9-mdw62"
Oct 30 21:16:46.936711 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.936693    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvgmh\" (UniqueName: \"kubernetes.io/projected/7c10ba3d-7759-4577-b5d6-d7da68fa9768-kube-api-access-pvgmh\") pod \"kas-connection-checker-685895c7c9-vmw5p\" (UID: \"7c10ba3d-7759-4577-b5d6-d7da68fa9768\") " pod="kube-system/kas-connection-checker-685895c7c9-vmw5p"
Oct 30 21:16:46.936800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.936781    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rs4\" (UniqueName: \"kubernetes.io/projected/50545deb-2e88-4316-b8ea-60ffa646dfd2-kube-api-access-s7rs4\") pod \"network-check-source-6f78d59f99-mddn5\" (UID: \"50545deb-2e88-4316-b8ea-60ffa646dfd2\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-mddn5"
Oct 30 21:16:46.937146 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.937117    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4fcs\" (UniqueName: \"kubernetes.io/projected/01942c94-e80e-4d86-8b44-529875c8d589-kube-api-access-j4fcs\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.938103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.938077    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckn2m\" (UniqueName: \"kubernetes.io/projected/07137761-f8df-48e8-b75a-5f7852665e13-kube-api-access-ckn2m\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:46.938482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.938462    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xwz8\" (UniqueName: \"kubernetes.io/projected/2bcb4b95-cf9f-4cd5-8628-4d716078026d-kube-api-access-7xwz8\") pod \"console-operator-7cd56b8dbc-2vz6h\" (UID: \"2bcb4b95-cf9f-4cd5-8628-4d716078026d\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:46.938764 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.938744    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85qhr\" (UniqueName: \"kubernetes.io/projected/239b6026-1bc2-4a79-ba5f-561ff6bb0570-kube-api-access-85qhr\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:46.939022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.939004    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq9gp\" (UniqueName: \"kubernetes.io/projected/94d63141-9177-4a26-be92-11125e1c5ab9-kube-api-access-wq9gp\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.939066 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.939044    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljp4\" (UniqueName: \"kubernetes.io/projected/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-kube-api-access-jljp4\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.939194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.939177    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbv79\" (UniqueName: \"kubernetes.io/projected/20532b77-4bbf-4b92-9321-79a2a2c55d16-kube-api-access-bbv79\") pod \"ingress-canary-kwbfv\" (UID: \"20532b77-4bbf-4b92-9321-79a2a2c55d16\") " pod="openshift-ingress-canary/ingress-canary-kwbfv"
Oct 30 21:16:46.939254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.939230    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcx7l\" (UniqueName: \"kubernetes.io/projected/1be33a60-7830-41ed-a8c4-28c576309568-kube-api-access-vcx7l\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.939608 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.939588    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7tmq\" (UniqueName: \"kubernetes.io/projected/f366bf9e-fcd7-4526-8370-9398ca15d07f-kube-api-access-n7tmq\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:46.939803 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.939789    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n64xl\" (UniqueName: \"kubernetes.io/projected/7c2b378d-932e-4e37-82f3-345110023994-kube-api-access-n64xl\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.941712 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.941697    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxgh9\" (UniqueName: \"kubernetes.io/projected/5f138350-181a-4d19-8b9a-445e4f1327d7-kube-api-access-gxgh9\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:46.942259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.942236    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnm8j\" (UniqueName: \"kubernetes.io/projected/df00af45-5cd4-4831-be47-b11a225559c2-kube-api-access-rnm8j\") pod \"migrator-66df5d496b-vj4nf\" (UID: \"df00af45-5cd4-4831-be47-b11a225559c2\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vj4nf"
Oct 30 21:16:46.942335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.942319    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.942649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.942634    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4w55\" (UniqueName: \"kubernetes.io/projected/2df32282-d6ce-4842-b488-880dcbb49979-kube-api-access-v4w55\") pod \"insights-operator-7c4986d449-d7kds\" (UID: \"2df32282-d6ce-4842-b488-880dcbb49979\") " pod="openshift-insights/insights-operator-7c4986d449-d7kds"
Oct 30 21:16:46.944260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.944244    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbnbr\" (UniqueName: \"kubernetes.io/projected/4b33cbaa-11aa-4d25-95bb-867618842766-kube-api-access-cbnbr\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.944298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.944262    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7g6j\" (UniqueName: \"kubernetes.io/projected/b9bc359e-dff6-4151-9210-553cb6cb727f-kube-api-access-b7g6j\") pod \"kas-connection-checker-685895c7c9-spg6c\" (UID: \"b9bc359e-dff6-4151-9210-553cb6cb727f\") " pod="kube-system/kas-connection-checker-685895c7c9-spg6c"
Oct 30 21:16:46.944298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.944250    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmdt8\" (UniqueName: \"kubernetes.io/projected/002a295e-6631-4813-96e7-a8f9936e05b3-kube-api-access-zmdt8\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.944384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.944371    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg9g\" (UniqueName: \"kubernetes.io/projected/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-kube-api-access-8jg9g\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:46.945658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.945642    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2h6f\" (UniqueName: \"kubernetes.io/projected/725fdb19-6f8c-406e-b4c4-f9b2597887ba-kube-api-access-b2h6f\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.946166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.946150    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qvqw\" (UniqueName: \"kubernetes.io/projected/bc5bcf28-7601-411c-a347-80adf8270f94-kube-api-access-7qvqw\") pod \"service-ca-operator-544d749c8c-lzs22\" (UID: \"bc5bcf28-7601-411c-a347-80adf8270f94\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22"
Oct 30 21:16:46.947491 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.947461    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxck9\" (UniqueName: \"kubernetes.io/projected/1fbe6abd-8922-454f-8ded-4e154da37cbe-kube-api-access-cxck9\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-h22gd\" (UID: \"1fbe6abd-8922-454f-8ded-4e154da37cbe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd"
Oct 30 21:16:46.947930 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.947910    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rlxf\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.947996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.947981    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lrjf\" (UniqueName: \"kubernetes.io/projected/093adaf9-e590-4301-b3f4-2d58afcf1398-kube-api-access-4lrjf\") pod \"volume-data-source-validator-58c9f5f46d-fgqwn\" (UID: \"093adaf9-e590-4301-b3f4-2d58afcf1398\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-fgqwn"
Oct 30 21:16:46.982294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982262    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982301    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-system-cni-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.982389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982320    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.982419 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982381    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.982419 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982390    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982419 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982384    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-system-cni-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982417    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982435    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-socket-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982445    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-host\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982471    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-bin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982447    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.982421    4943 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982510    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-bin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982486    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysconfig\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.982541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982533    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysconfig\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982564    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-multus-certs\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982549    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7ef1df8-7bdf-42c3-9934-ba7929ffa72d-host\") pod \"node-ca-z92xh\" (UID: \"e7ef1df8-7bdf-42c3-9934-ba7929ffa72d\") " pod="openshift-image-registry/node-ca-z92xh"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982591    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-kubernetes\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982599    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-multus-certs\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.982622    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.482599641 +0000 UTC m=+1.978172988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982629    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-kubernetes\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982673    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982701    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-device-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982728    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982752    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-device-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982764    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.982776    4943 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982806    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-log-socket\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982766    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-log-socket\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.982838    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.482826328 +0000 UTC m=+1.978399673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : configmap "kube-rbac-proxy" not found
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982863    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cnibin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982905    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982917    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-cnibin\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982927    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:46.982933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982943    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982946    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982964    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-var-lib-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982984    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-systemd-units\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.982998    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983010    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983022    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-netns\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983018    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-var-lib-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983030    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-systemd-units\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.982999    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-netns\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983056    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483045449 +0000 UTC m=+1.978618795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983058    4943 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983071    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-socket-dir-parent\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983102    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483087977 +0000 UTC m=+1.978661324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983112    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-socket-dir-parent\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983120    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239b6026-1bc2-4a79-ba5f-561ff6bb0570-host-slash\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983151    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-dbus\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983170    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/239b6026-1bc2-4a79-ba5f-561ff6bb0570-host-slash\") pod \"iptables-alerter-7jmrh\" (UID: \"239b6026-1bc2-4a79-ba5f-561ff6bb0570\") " pod="openshift-network-operator/iptables-alerter-7jmrh"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983178    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983206    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983235    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-etc-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983245    4943 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983211    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-dbus\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983263    4943 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983271    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-ovn\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983292    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483279762 +0000 UTC m=+1.978853099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983299    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-etc-openvswitch\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983308    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-ovn\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983313    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483304086 +0000 UTC m=+1.978877430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983352    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983381    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-var-lib-kubelet\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983407    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01942c94-e80e-4d86-8b44-529875c8d589-crio-socket\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983421    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-var-lib-kubelet\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983412    4943 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983434    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983441    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01942c94-e80e-4d86-8b44-529875c8d589-crio-socket\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983460    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983468    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483456628 +0000 UTC m=+1.979029978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983519    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483506486 +0000 UTC m=+1.979079829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983524    4943 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983568    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-systemd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983588    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-bin\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983600    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-run-systemd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983613    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483599208 +0000 UTC m=+1.979172540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983615    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-bin\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983637    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-slash\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983656    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-slash\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983669    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-kubelet\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983696    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-conf-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983719    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-kubelet\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983722    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f366bf9e-fcd7-4526-8370-9398ca15d07f-hosts-file\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983750    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-conf\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983745    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-multus-conf-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983777    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-node-log\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983803    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-system-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983808    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f366bf9e-fcd7-4526-8370-9398ca15d07f-hosts-file\") pod \"node-resolver-hlvrt\" (UID: \"f366bf9e-fcd7-4526-8370-9398ca15d07f\") " pod="openshift-dns/node-resolver-hlvrt"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983825    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-cnibin\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983842    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-node-log\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983849    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-conf\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983852    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983870    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-cnibin\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983875    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-system-cni-dir\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983878    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-modprobe-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.983866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983902    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983924    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983926    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983953    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983955    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-sys\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983960    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-registration-dir\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.983933    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983978    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-modprobe-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983992    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-sys\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.983993    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-k8s-cni-cncf-io\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.984008    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.483995829 +0000 UTC m=+1.979569172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984023    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-k8s-cni-cncf-io\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984035    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984056    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-lib-modules\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984071    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-netd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984095    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1be33a60-7830-41ed-a8c4-28c576309568-host-cni-netd\") pod \"ovnkube-node-j2ck7\" (UID: \"1be33a60-7830-41ed-a8c4-28c576309568\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984111    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-multus\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.984124    4943 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984127    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984141    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-lib-modules\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984163    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-cni-multus\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:46.984170    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:47.484152927 +0000 UTC m=+1.979726270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : secret "metrics-daemon-secret" not found
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984197    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-host\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984200    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-sysctl-d\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984216    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-kubelet\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984250    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-var-lib-kubelet\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984254    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-run\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984278    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-hostroot\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984301    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984317    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-hostroot\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984322    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-netns\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984258    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-host\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984279    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-run\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984345    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984365    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-host-run-netns\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984371    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-etc-selinux\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984373    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-systemd\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984403    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/94d63141-9177-4a26-be92-11125e1c5ab9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-blmqq\" (UID: \"94d63141-9177-4a26-be92-11125e1c5ab9\") " pod="openshift-multus/multus-additional-cni-plugins-blmqq"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984412    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984417    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b33cbaa-11aa-4d25-95bb-867618842766-etc-systemd\") pod \"tuned-4l6nm\" (UID: \"4b33cbaa-11aa-4d25-95bb-867618842766\") " pod="openshift-cluster-node-tuning-operator/tuned-4l6nm"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984437    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-kubelet-config\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984444    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7c2b378d-932e-4e37-82f3-345110023994-sys-fs\") pod \"aws-ebs-csi-driver-node-mm9mx\" (UID: \"7c2b378d-932e-4e37-82f3-345110023994\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mm9mx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984456    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-etc-kubernetes\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984505    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26f80d0e-54bd-400f-9b86-7103ea34895a-kubelet-config\") pod \"global-pull-secret-syncer-2g9kx\" (UID: \"26f80d0e-54bd-400f-9b86-7103ea34895a\") " pod="kube-system/global-pull-secret-syncer-2g9kx"
Oct 30 21:16:46.985665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:46.984508    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/725fdb19-6f8c-406e-b4c4-f9b2597887ba-etc-kubernetes\") pod \"multus-44tnc\" (UID: \"725fdb19-6f8c-406e-b4c4-f9b2597887ba\") " pod="openshift-multus/multus-44tnc"
Oct 30 21:16:47.021131 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.021106    4943 scope.go:122] "RemoveContainer" containerID="2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415"
Oct 30 21:16:47.075255 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.075204    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:47.489884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.489854    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:47.489884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.489886    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.489910    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.489987    4943 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.489992    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490013    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490019    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490029    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490017395 +0000 UTC m=+2.985590723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490056    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490044732 +0000 UTC m=+2.985618063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490065    4943 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490081    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490086    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490079517 +0000 UTC m=+2.985652845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490098    4943 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:47.490112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490117    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490125    4943 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490128    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490117464 +0000 UTC m=+2.985690823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490164    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490155841 +0000 UTC m=+2.985729169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490175    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490206    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490208    4943 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490219    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490212226 +0000 UTC m=+2.985785608 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490233    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490227475 +0000 UTC m=+2.985800803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490255    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490263    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490281    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490274819 +0000 UTC m=+2.985848148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490255    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490286    4943 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490307    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490302113 +0000 UTC m=+2.985875490 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : secret "metrics-daemon-secret" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490336    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.490364    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490401    4943 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490408    4943 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490423    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490417028 +0000 UTC m=+2.985990358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:47.490499 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.490434    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:48.490427745 +0000 UTC m=+2.986001074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : configmap "kube-rbac-proxy" not found
Oct 30 21:16:47.665926 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.665898    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:16:47.666354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.666339    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/1.log"
Oct 30 21:16:47.666409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.666369    4943 generic.go:356] "Generic (PLEG): container finished" podID="2bcb4b95-cf9f-4cd5-8628-4d716078026d" containerID="abb32b540e7b1c2be3c5861833bdb19c078de0eaba2b78c854bbafff6152c059" exitCode=255
Oct 30 21:16:47.666467 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.666447    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" event={"ID":"2bcb4b95-cf9f-4cd5-8628-4d716078026d","Type":"ContainerDied","Data":"abb32b540e7b1c2be3c5861833bdb19c078de0eaba2b78c854bbafff6152c059"}
Oct 30 21:16:47.666508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.666499    4943 scope.go:122] "RemoveContainer" containerID="2ab76a995bf63f7a436b8ad2d264ac53833e237df822b9227e7f147049410415"
Oct 30 21:16:47.667004 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:47.666983    4943 scope.go:122] "RemoveContainer" containerID="abb32b540e7b1c2be3c5861833bdb19c078de0eaba2b78c854bbafff6152c059"
Oct 30 21:16:47.667167 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:47.667150    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2vz6h_openshift-console-operator(2bcb4b95-cf9f-4cd5-8628-4d716078026d)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" podUID="2bcb4b95-cf9f-4cd5-8628-4d716078026d"
Oct 30 21:16:48.497710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497678    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:48.497710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497714    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497743    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497771    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497808    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.497830    4943 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.497850    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.497830617 +0000 UTC m=+4.993403953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.497876    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.497864546 +0000 UTC m=+4.993437892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : secret "router-metrics-certs-default" not found
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497903    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497932    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.497905    4943 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497954    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.497909    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.497998    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498010    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498022    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:48.498024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.498025    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498012    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.498056    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498082    4943 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.497935    4943 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498116    4943 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498148    4943 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.497916    4943 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498089    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498073932 +0000 UTC m=+4.993647285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498228    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498215682 +0000 UTC m=+4.993789012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498240    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls podName:002a295e-6631-4813-96e7-a8f9936e05b3 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498234074 +0000 UTC m=+4.993807403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls") pod "dns-default-7zdht" (UID: "002a295e-6631-4813-96e7-a8f9936e05b3") : secret "dns-default-metrics-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498088    4943 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498251    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498245482 +0000 UTC m=+4.993818810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498267    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498262123 +0000 UTC m=+4.993835451 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : configmap "kube-rbac-proxy" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498279    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498274263 +0000 UTC m=+4.993847592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498292    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls podName:5f138350-181a-4d19-8b9a-445e4f1327d7 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498287135 +0000 UTC m=+4.993860464 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-l6tt9" (UID: "5f138350-181a-4d19-8b9a-445e4f1327d7") : secret "cluster-monitoring-operator-tls" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498305    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs podName:8947b771-89ac-46dc-9f8c-f218bdfaa7f5 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498300478 +0000 UTC m=+4.993873806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs") pod "network-metrics-daemon-hstlp" (UID: "8947b771-89ac-46dc-9f8c-f218bdfaa7f5") : secret "metrics-daemon-secret" not found
Oct 30 21:16:48.498543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:48.498318    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:50.498313652 +0000 UTC m=+4.993886981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:48.670708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.670681    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:16:48.973704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:48.973656    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:49.152812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:49.152784    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:49.502530 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:49.502506    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:49.538569 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:49.538536    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:16:49.579229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:49.579205    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:49.793105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:49.793026    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:50.021706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.021679    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:50.037545 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.037526    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlvrt_f366bf9e-fcd7-4526-8370-9398ca15d07f/dns-node-resolver/0.log"
Oct 30 21:16:50.111139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.111078    4943 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:50.111452 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.111436    4943 scope.go:122] "RemoveContainer" containerID="abb32b540e7b1c2be3c5861833bdb19c078de0eaba2b78c854bbafff6152c059"
Oct 30 21:16:50.111658 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.111638    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2vz6h_openshift-console-operator(2bcb4b95-cf9f-4cd5-8628-4d716078026d)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" podUID="2bcb4b95-cf9f-4cd5-8628-4d716078026d"
Oct 30 21:16:50.194035 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.194014    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:50.515991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.515961    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:50.515991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516000    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516018    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516042    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516067    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516123    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:16:54.516106805 +0000 UTC m=+9.011680146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516149    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516168    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-675c47d4b7-tznvs: secret "image-registry-tls" not found
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516152    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516212    4943 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:50.516242 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516215    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls podName:a4707941-37b8-49cf-bc81-71a49d4ba37e nodeName:}" failed. No retries permitted until 2026-10-30 21:16:54.516200441 +0000 UTC m=+9.011773794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls") pod "image-registry-675c47d4b7-tznvs" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e") : secret "image-registry-tls" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516258    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:54.516246208 +0000 UTC m=+9.011819538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516297    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516343    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516365    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516402    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516403    4943 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516420    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516423    4943 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516435    4943 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-c9745cfc4-b9rb6: secret "image-registry-tls" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516473    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls podName:00d37d93-ae84-4f68-a6a7-f0c02045169b nodeName:}" failed. No retries permitted until 2026-10-30 21:16:54.516461467 +0000 UTC m=+9.012034799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls") pod "image-registry-c9745cfc4-b9rb6" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b") : secret "image-registry-tls" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516511    4943 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516526    4943 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516548    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:16:54.516535425 +0000 UTC m=+9.012108778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:50.516724 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:50.516583    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls podName:07137761-f8df-48e8-b75a-5f7852665e13 nodeName:}" failed. No retries permitted until 2026-10-30 21:16:54.516573837 +0000 UTC m=+9.012147167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-xxsvp" (UID: "07137761-f8df-48e8-b75a-5f7852665e13") : secret "samples-operator-tls" not found
Oct 30 21:16:50.517255 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.516879    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01942c94-e80e-4d86-8b44-529875c8d589-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:50.518761 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.518740    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-metrics-certs\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:50.518898 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.518786    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f138350-181a-4d19-8b9a-445e4f1327d7-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-l6tt9\" (UID: \"5f138350-181a-4d19-8b9a-445e4f1327d7\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:50.518972 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.518928    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/002a295e-6631-4813-96e7-a8f9936e05b3-metrics-tls\") pod \"dns-default-7zdht\" (UID: \"002a295e-6631-4813-96e7-a8f9936e05b3\") " pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:50.519045 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.519023    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8947b771-89ac-46dc-9f8c-f218bdfaa7f5-metrics-certs\") pod \"network-metrics-daemon-hstlp\" (UID: \"8947b771-89ac-46dc-9f8c-f218bdfaa7f5\") " pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:50.623008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.622987    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"
Oct 30 21:16:50.626154 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.626136    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hstlp"
Oct 30 21:16:50.634325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:50.634307    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:51.111195 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.111118    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9"]
Oct 30 21:16:51.111986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.111965    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hstlp"]
Oct 30 21:16:51.115091 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:51.115060    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f138350_181a_4d19_8b9a_445e4f1327d7.slice/crio-16c3a475dffb5061b32029cba987ea239ca235a5239f47377164e10e8c67ac33 WatchSource:0}: Error finding container 16c3a475dffb5061b32029cba987ea239ca235a5239f47377164e10e8c67ac33: Status 404 returned error can't find the container with id 16c3a475dffb5061b32029cba987ea239ca235a5239f47377164e10e8c67ac33
Oct 30 21:16:51.116960 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.116947    4943 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:16:51.148260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.148241    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z92xh_e7ef1df8-7bdf-42c3-9934-ba7929ffa72d/node-ca/0.log"
Oct 30 21:16:51.154496 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:51.154477    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8947b771_89ac_46dc_9f8c_f218bdfaa7f5.slice/crio-b864bce0fe77cae2f0e3614d7271ea46fd394adc49bd9ea45a9c2f370e6f7ca0 WatchSource:0}: Error finding container b864bce0fe77cae2f0e3614d7271ea46fd394adc49bd9ea45a9c2f370e6f7ca0: Status 404 returned error can't find the container with id b864bce0fe77cae2f0e3614d7271ea46fd394adc49bd9ea45a9c2f370e6f7ca0
Oct 30 21:16:51.162662 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.162642    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7zdht"]
Oct 30 21:16:51.166051 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:51.166030    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002a295e_6631_4813_96e7_a8f9936e05b3.slice/crio-ff38203ed71b9e00b775d44677c02a585c8fb67f6f5f03a01bb9bbf9869f40cf WatchSource:0}: Error finding container ff38203ed71b9e00b775d44677c02a585c8fb67f6f5f03a01bb9bbf9869f40cf: Status 404 returned error can't find the container with id ff38203ed71b9e00b775d44677c02a585c8fb67f6f5f03a01bb9bbf9869f40cf
Oct 30 21:16:51.547989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.547963    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kwbfv_20532b77-4bbf-4b92-9321-79a2a2c55d16/serve-healthcheck-canary/0.log"
Oct 30 21:16:51.680970 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.680937    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zdht" event={"ID":"002a295e-6631-4813-96e7-a8f9936e05b3","Type":"ContainerStarted","Data":"ff38203ed71b9e00b775d44677c02a585c8fb67f6f5f03a01bb9bbf9869f40cf"}
Oct 30 21:16:51.681938 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.681914    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9" event={"ID":"5f138350-181a-4d19-8b9a-445e4f1327d7","Type":"ContainerStarted","Data":"16c3a475dffb5061b32029cba987ea239ca235a5239f47377164e10e8c67ac33"}
Oct 30 21:16:51.683038 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:51.683019    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hstlp" event={"ID":"8947b771-89ac-46dc-9f8c-f218bdfaa7f5","Type":"ContainerStarted","Data":"b864bce0fe77cae2f0e3614d7271ea46fd394adc49bd9ea45a9c2f370e6f7ca0"}
Oct 30 21:16:52.148492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:52.148460    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-vj4nf_df00af45-5cd4-4831-be47-b11a225559c2/migrator/0.log"
Oct 30 21:16:52.187194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:52.187166    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:16:52.187587 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:52.187566    4943 scope.go:122] "RemoveContainer" containerID="abb32b540e7b1c2be3c5861833bdb19c078de0eaba2b78c854bbafff6152c059"
Oct 30 21:16:52.187773 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:52.187753    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-2vz6h_openshift-console-operator(2bcb4b95-cf9f-4cd5-8628-4d716078026d)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" podUID="2bcb4b95-cf9f-4cd5-8628-4d716078026d"
Oct 30 21:16:52.348783 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:52.348749    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-h22gd_1fbe6abd-8922-454f-8ded-4e154da37cbe/kube-storage-version-migrator-operator/0.log"
Oct 30 21:16:53.692116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:53.692081    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hstlp" event={"ID":"8947b771-89ac-46dc-9f8c-f218bdfaa7f5","Type":"ContainerStarted","Data":"17d4a972759d44f366aa570456c791485285fa3d1d2dfd62ec686127df1d1f41"}
Oct 30 21:16:53.692589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:53.692149    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hstlp" event={"ID":"8947b771-89ac-46dc-9f8c-f218bdfaa7f5","Type":"ContainerStarted","Data":"f67bb8a271a6c8dd14de34a3ad2a69336f07b1f6ec8ae7f46ebf895240744cae"}
Oct 30 21:16:54.013484 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.013403    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:54.013657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.013628    4943 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:16:54.552204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.552181    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:54.552315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.552234    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:16:54.552315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.552265    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:54.552430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.552330    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:54.552430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.552357    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:16:54.552430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.552378    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:16:54.552430 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:54.552389    4943 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:54.552666 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:54.552446    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls podName:01942c94-e80e-4d86-8b44-529875c8d589 nodeName:}" failed. No retries permitted until 2026-10-30 21:17:02.552432349 +0000 UTC m=+17.048005695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls") pod "insights-runtime-extractor-57nxn" (UID: "01942c94-e80e-4d86-8b44-529875c8d589") : secret "insights-runtime-extractor-tls" not found
Oct 30 21:16:54.552666 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:54.552503    4943 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 30 21:16:54.552666 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:54.552505    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle podName:43aedfd0-4a10-4c6e-8ff4-c79f457d1aab nodeName:}" failed. No retries permitted until 2026-10-30 21:17:02.552488637 +0000 UTC m=+17.048061984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle") pod "router-default-6d7bfbd7bc-slk74" (UID: "43aedfd0-4a10-4c6e-8ff4-c79f457d1aab") : configmap references non-existent config key: service-ca.crt
Oct 30 21:16:54.552666 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:16:54.552540    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert podName:8a1d8929-5e86-41ec-9298-26531344f8ee nodeName:}" failed. No retries permitted until 2026-10-30 21:17:02.552529621 +0000 UTC m=+17.048102954 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-stjmx" (UID: "8a1d8929-5e86-41ec-9298-26531344f8ee") : secret "networking-console-plugin-cert" not found
Oct 30 21:16:54.554600 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.554573    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"image-registry-675c47d4b7-tznvs\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") " pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:54.554817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.554796    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07137761-f8df-48e8-b75a-5f7852665e13-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-xxsvp\" (UID: \"07137761-f8df-48e8-b75a-5f7852665e13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:54.554817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.554809    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"image-registry-c9745cfc4-b9rb6\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") " pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:54.696490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.696429    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zdht" event={"ID":"002a295e-6631-4813-96e7-a8f9936e05b3","Type":"ContainerStarted","Data":"1b4e4b52b8e19c649c7b8c665336c9ab5df273be3a53c5243526b382666f3319"}
Oct 30 21:16:54.696871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.696489    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7zdht" event={"ID":"002a295e-6631-4813-96e7-a8f9936e05b3","Type":"ContainerStarted","Data":"a980b37f02bba62d746f8d2f8d200ea5d4112dea55bd469d2acbc553e02d1ab5"}
Oct 30 21:16:54.696871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.696650    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7zdht"
Oct 30 21:16:54.698020 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.698000    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-l6tt9" event={"ID":"5f138350-181a-4d19-8b9a-445e4f1327d7","Type":"ContainerStarted","Data":"adabe0d0baa51f826ff3aa12881fd15a96a8b16d292efd16780704cbdec74552"}
Oct 30 21:16:54.822669 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.822640    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"
Oct 30 21:16:54.824818 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.824800    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:16:54.834053 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:54.834002    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:55.208578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.208496    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp"]
Oct 30 21:16:55.261468 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.261443    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c9745cfc4-b9rb6"]
Oct 30 21:16:55.274879 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:55.274849    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d37d93_ae84_4f68_a6a7_f0c02045169b.slice/crio-6e139a4b428485d7aeb8ee5274f8bbfbb6005d8aaccecdc9fc9c15dfe3aba24e WatchSource:0}: Error finding container 6e139a4b428485d7aeb8ee5274f8bbfbb6005d8aaccecdc9fc9c15dfe3aba24e: Status 404 returned error can't find the container with id 6e139a4b428485d7aeb8ee5274f8bbfbb6005d8aaccecdc9fc9c15dfe3aba24e
Oct 30 21:16:55.314058 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.314031    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-675c47d4b7-tznvs"]
Oct 30 21:16:55.316975 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:16:55.316947    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4707941_37b8_49cf_bc81_71a49d4ba37e.slice/crio-65b6b751e00d5ae3935ad1549ad0d9af3792d21b80389b55a5b8d9d84c6893e6 WatchSource:0}: Error finding container 65b6b751e00d5ae3935ad1549ad0d9af3792d21b80389b55a5b8d9d84c6893e6: Status 404 returned error can't find the container with id 65b6b751e00d5ae3935ad1549ad0d9af3792d21b80389b55a5b8d9d84c6893e6
Oct 30 21:16:55.702691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.702657    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs" event={"ID":"a4707941-37b8-49cf-bc81-71a49d4ba37e","Type":"ContainerStarted","Data":"6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad"}
Oct 30 21:16:55.703136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.702725    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs" event={"ID":"a4707941-37b8-49cf-bc81-71a49d4ba37e","Type":"ContainerStarted","Data":"65b6b751e00d5ae3935ad1549ad0d9af3792d21b80389b55a5b8d9d84c6893e6"}
Oct 30 21:16:55.703888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.703832    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp" event={"ID":"07137761-f8df-48e8-b75a-5f7852665e13","Type":"ContainerStarted","Data":"cd845f58b777671caa96309ea1b9205df490b1103aef69404c40b5ec972e390e"}
Oct 30 21:16:55.705396 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.705369    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6" event={"ID":"00d37d93-ae84-4f68-a6a7-f0c02045169b","Type":"ContainerStarted","Data":"093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc"}
Oct 30 21:16:55.705480 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:55.705407    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6" event={"ID":"00d37d93-ae84-4f68-a6a7-f0c02045169b","Type":"ContainerStarted","Data":"6e139a4b428485d7aeb8ee5274f8bbfbb6005d8aaccecdc9fc9c15dfe3aba24e"}
Oct 30 21:16:56.225574 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:56.225529    4943 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-135-205.us-west-1.compute.internal" event="NodeReady"
Oct 30 21:16:56.323287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:56.323255    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:56.527826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:56.527695    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:56.709427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:56.709397    4943 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:16:56.709889 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:56.709397    4943 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 30 21:16:56.754925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:56.754892    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:57.199037 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.198993    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:57.309709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.309672    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2ck7"
Oct 30 21:16:57.411754 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.411711    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:16:57.593732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.593662    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:57.610961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.610941    4943 scope.go:122] "RemoveContainer" containerID="abb32b540e7b1c2be3c5861833bdb19c078de0eaba2b78c854bbafff6152c059"
Oct 30 21:16:57.720866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.720843    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:16:57.721242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.720936    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h" event={"ID":"2bcb4b95-cf9f-4cd5-8628-4d716078026d","Type":"ContainerStarted","Data":"a04dcdd15f4335912a88c09ee5eaa91fa6afd4557226ea6fd5a2138421fee93d"}
Oct 30 21:16:57.722615 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.722591    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp" event={"ID":"07137761-f8df-48e8-b75a-5f7852665e13","Type":"ContainerStarted","Data":"cd9e12d8aea0289948121752b91048d148ced94980698c2270cbf358cb401ea4"}
Oct 30 21:16:57.804621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.804593    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:57.993925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:57.993896    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:58.393755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:58.393682    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:58.688337 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:58.688312    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:58.728016 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:58.727985    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-xxsvp" event={"ID":"07137761-f8df-48e8-b75a-5f7852665e13","Type":"ContainerStarted","Data":"d2095909f84c0c19b984306841daf33b73af1b39876aeb39daf01f562c5c9d6c"}
Oct 30 21:16:59.150197 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:59.150168    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:59.334857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:59.334820    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:59.521545 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:59.521477    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:59.703831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:59.703801    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:16:59.880307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:16:59.880236    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:00.058184 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:00.058149    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:00.392209 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:00.392176    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:00.593530 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:00.593498    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:01.152446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:01.152414    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:01.319419 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:01.319386    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:01.547599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:01.547513    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:01.718596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:01.718549    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:02.624574 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.624528    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:17:02.624961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.624595    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:17:02.624961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.624620    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:17:02.625203 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.625184    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43aedfd0-4a10-4c6e-8ff4-c79f457d1aab-service-ca-bundle\") pod \"router-default-6d7bfbd7bc-slk74\" (UID: \"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab\") " pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:17:02.626921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.626894    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01942c94-e80e-4d86-8b44-529875c8d589-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57nxn\" (UID: \"01942c94-e80e-4d86-8b44-529875c8d589\") " pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:17:02.627051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.627032    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8a1d8929-5e86-41ec-9298-26531344f8ee-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-stjmx\" (UID: \"8a1d8929-5e86-41ec-9298-26531344f8ee\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:17:02.635881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.635862    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57nxn"
Oct 30 21:17:02.922266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.922236    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:17:02.925387 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:02.925364    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx"
Oct 30 21:17:03.044837 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.044710    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57nxn"]
Oct 30 21:17:03.048578 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:17:03.048538    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01942c94_e80e_4d86_8b44_529875c8d589.slice/crio-c8c55deb13fdb081ded9f502c9ea2bf201b3afe84decb41c6a24d0f0d3c7c7ed WatchSource:0}: Error finding container c8c55deb13fdb081ded9f502c9ea2bf201b3afe84decb41c6a24d0f0d3c7c7ed: Status 404 returned error can't find the container with id c8c55deb13fdb081ded9f502c9ea2bf201b3afe84decb41c6a24d0f0d3c7c7ed
Oct 30 21:17:03.259049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.258936    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:17:03.260710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.260686    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9745cfc4-b9rb6"]
Oct 30 21:17:03.329922 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.329883    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d7bfbd7bc-slk74"]
Oct 30 21:17:03.333875 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:17:03.333844    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43aedfd0_4a10_4c6e_8ff4_c79f457d1aab.slice/crio-cc851d5cf6547ab3224ff390814739dc53dc5e75050d604f9ab0144778ed5595 WatchSource:0}: Error finding container cc851d5cf6547ab3224ff390814739dc53dc5e75050d604f9ab0144778ed5595: Status 404 returned error can't find the container with id cc851d5cf6547ab3224ff390814739dc53dc5e75050d604f9ab0144778ed5595
Oct 30 21:17:03.380694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.380668    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-stjmx"]
Oct 30 21:17:03.383966 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:17:03.383941    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1d8929_5e86_41ec_9298_26531344f8ee.slice/crio-f59c91910367d39a49e482fb44eb584bb867bf9a81dd76b31598e97de34e0cd9 WatchSource:0}: Error finding container f59c91910367d39a49e482fb44eb584bb867bf9a81dd76b31598e97de34e0cd9: Status 404 returned error can't find the container with id f59c91910367d39a49e482fb44eb584bb867bf9a81dd76b31598e97de34e0cd9
Oct 30 21:17:03.399845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.399814    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:03.593069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.592982    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:03.745348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.745307    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74" event={"ID":"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab","Type":"ContainerStarted","Data":"4542de7b733a4c0e04b825fa4fe31fa0658950d1a989e9f483c3e3d39c2165dc"}
Oct 30 21:17:03.745804 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.745365    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74" event={"ID":"43aedfd0-4a10-4c6e-8ff4-c79f457d1aab","Type":"ContainerStarted","Data":"cc851d5cf6547ab3224ff390814739dc53dc5e75050d604f9ab0144778ed5595"}
Oct 30 21:17:03.746890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.746859    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx" event={"ID":"8a1d8929-5e86-41ec-9298-26531344f8ee","Type":"ContainerStarted","Data":"f59c91910367d39a49e482fb44eb584bb867bf9a81dd76b31598e97de34e0cd9"}
Oct 30 21:17:03.748673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.748648    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nxn" event={"ID":"01942c94-e80e-4d86-8b44-529875c8d589","Type":"ContainerStarted","Data":"e5bd5c97af9df51b287402127af0566678ae10212566607ccbd9dbe848e2a555"}
Oct 30 21:17:03.748765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.748693    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nxn" event={"ID":"01942c94-e80e-4d86-8b44-529875c8d589","Type":"ContainerStarted","Data":"c8c55deb13fdb081ded9f502c9ea2bf201b3afe84decb41c6a24d0f0d3c7c7ed"}
Oct 30 21:17:03.923401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.923368    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:17:03.926012 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.925981    4943 patch_prober.go:29] interesting pod/router-default-6d7bfbd7bc-slk74 container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld
Oct 30 21:17:03.926012 ip-10-0-135-205 kubenswrapper[4943]: [+]has-synced ok
Oct 30 21:17:03.926012 ip-10-0-135-205 kubenswrapper[4943]: [+]process-running ok
Oct 30 21:17:03.926012 ip-10-0-135-205 kubenswrapper[4943]: healthz check failed
Oct 30 21:17:03.926306 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.926031    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74" podUID="43aedfd0-4a10-4c6e-8ff4-c79f457d1aab" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Oct 30 21:17:03.990916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.990890    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6pzlh"
Oct 30 21:17:03.991254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:03.991229    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:04.174752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:04.174683    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:04.707891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:04.707860    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7zdht"
Oct 30 21:17:04.754228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:04.754164    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nxn" event={"ID":"01942c94-e80e-4d86-8b44-529875c8d589","Type":"ContainerStarted","Data":"475b8c12320dbed49cceb28d56710344f4eeb17b3b496e6644bd98d3ed00c36c"}
Oct 30 21:17:04.924716 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:04.924686    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:17:05.653059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:05.653017    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:05.759277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:05.759199    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-stjmx" event={"ID":"8a1d8929-5e86-41ec-9298-26531344f8ee","Type":"ContainerStarted","Data":"e44741fafc37d4d1f872d1dcaf12fe790e11b4af06194865d00d79081a818745"}
Oct 30 21:17:05.759755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:05.759582    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:17:05.760882 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:05.760857    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d7bfbd7bc-slk74"
Oct 30 21:17:06.418333 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:06.418268    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:06.584982 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:06.584950    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:07.637102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:07.637063    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:07.768233 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:07.768203    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57nxn" event={"ID":"01942c94-e80e-4d86-8b44-529875c8d589","Type":"ContainerStarted","Data":"773fb82b878c3445459c36024d3831347e6f8821299b69e36b176d949c4b7546"}
Oct 30 21:17:07.814867 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:07.814837    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:08.012830 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:08.012798    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:08.201140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:08.201106    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:08.728872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:08.728843    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:17:08.732463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:08.732447    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-2vz6h"
Oct 30 21:17:13.754681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:13.754652    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:17:13.771201 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:13.771178    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:13.958763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:13.958734    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:14.142598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.142517    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:14.318667 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.318636    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:14.518228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.518181    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:14.675536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.675501    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dv6r2"]
Oct 30 21:17:14.678314 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.678293    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.714247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.714196    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:14.730194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.730157    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 30 21:17:14.779661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.779550    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 30 21:17:14.779661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.779595    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 30 21:17:14.779661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.779634    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 30 21:17:14.780193 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.779665    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qn5sj\""
Oct 30 21:17:14.818188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818150    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818194    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75af6668-aa78-4062-91a4-dec32ccb82f4-metrics-client-ca\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818217    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-wtmp\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818289    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-root\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818385    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-textfile\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818412    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9rs\" (UniqueName: \"kubernetes.io/projected/75af6668-aa78-4062-91a4-dec32ccb82f4-kube-api-access-8l9rs\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818433    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-sys\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818453    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.818637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.818625    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-tls\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.905027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.904999    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:14.919173 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919143    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-textfile\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919182    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9rs\" (UniqueName: \"kubernetes.io/projected/75af6668-aa78-4062-91a4-dec32ccb82f4-kube-api-access-8l9rs\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919205    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-sys\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919222    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919266    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-tls\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919279    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-sys\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919318    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919355    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75af6668-aa78-4062-91a4-dec32ccb82f4-metrics-client-ca\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919377    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-wtmp\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919395    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-root\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919468    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-root\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919536    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-textfile\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919952 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919585    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-wtmp\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.919952 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919883    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-accelerators-collector-config\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.920038 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.919969    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/75af6668-aa78-4062-91a4-dec32ccb82f4-metrics-client-ca\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.921834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.921808    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.921925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.921876    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/75af6668-aa78-4062-91a4-dec32ccb82f4-node-exporter-tls\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.975495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.975464    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9rs\" (UniqueName: \"kubernetes.io/projected/75af6668-aa78-4062-91a4-dec32ccb82f4-kube-api-access-8l9rs\") pod \"node-exporter-dv6r2\" (UID: \"75af6668-aa78-4062-91a4-dec32ccb82f4\") " pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:14.990320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:14.990294    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dv6r2"
Oct 30 21:17:15.000820 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:17:15.000797    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75af6668_aa78_4062_91a4_dec32ccb82f4.slice/crio-6c478723918de06916345a16f6e91b4c316c2c74e80286812951c1cf87bbdaf4 WatchSource:0}: Error finding container 6c478723918de06916345a16f6e91b4c316c2c74e80286812951c1cf87bbdaf4: Status 404 returned error can't find the container with id 6c478723918de06916345a16f6e91b4c316c2c74e80286812951c1cf87bbdaf4
Oct 30 21:17:15.081836 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:15.081775    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:15.260438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:15.260409    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:15.797343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:15.797313    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dv6r2" event={"ID":"75af6668-aa78-4062-91a4-dec32ccb82f4","Type":"ContainerStarted","Data":"6c478723918de06916345a16f6e91b4c316c2c74e80286812951c1cf87bbdaf4"}
Oct 30 21:17:15.967462 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:15.967425    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:16.182646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:16.182616    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:16.560939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:16.560912    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:16.802705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:16.802616    4943 generic.go:356] "Generic (PLEG): container finished" podID="75af6668-aa78-4062-91a4-dec32ccb82f4" containerID="7b691aec738dcc85e1389bc5727ff2d97fdc22dd1c2fa79a98bf406cbd92c4c6" exitCode=0
Oct 30 21:17:16.803112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:16.802705    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dv6r2" event={"ID":"75af6668-aa78-4062-91a4-dec32ccb82f4","Type":"ContainerDied","Data":"7b691aec738dcc85e1389bc5727ff2d97fdc22dd1c2fa79a98bf406cbd92c4c6"}
Oct 30 21:17:16.834707 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:16.834685    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:17.552465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:17.552434    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:17.727332 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:17.727304    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:17:17.742832 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:17.742801    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:17.808839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:17.808769    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dv6r2" event={"ID":"75af6668-aa78-4062-91a4-dec32ccb82f4","Type":"ContainerStarted","Data":"9193dadde16efb0b1fef8b88bcce45f3b9ca614661dd242bb49b8b60b4e179d4"}
Oct 30 21:17:17.808839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:17.808823    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dv6r2" event={"ID":"75af6668-aa78-4062-91a4-dec32ccb82f4","Type":"ContainerStarted","Data":"8cea957b6dc41627e61496ac018c48005fe6577b28d759c0162eb635bc89b4b8"}
Oct 30 21:17:17.961056 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:17.960999    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dv6r2" podStartSLOduration=2.511372942 podStartE2EDuration="3.960983754s" totalImagesPullingTime="1.381273514s" totalInitContainerRuntime="68.337298ms" isStatefulPod=true podCreationTimestamp="2026-10-30 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:17:17.960058584 +0000 UTC m=+32.455631936" watchObservedRunningTime="2026-10-30 21:17:17.960983754 +0000 UTC m=+32.456557104"
Oct 30 21:17:18.724280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:18.724254    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:18.965353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:18.965319    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:19.139665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:19.139592    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:19.314172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:19.314138    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:19.504013 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:19.503983    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:19.541106 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:19.541081    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cmvnx"
Oct 30 21:17:21.062149 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:17:21.062103    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:17:21.861785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:21.861756    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:22.035907 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:22.035871    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:22.208758 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:22.208726    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:23.728145 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:23.728113    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:26.198229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:26.198187    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:26.300631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:26.300603    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-675c47d4b7-tznvs"]
Oct 30 21:17:26.384889 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:26.384859    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:26.564283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:26.564187    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:26.751890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:26.751839    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:26.924823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:26.924792    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:28.767450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:28.767409    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6" podUID="00d37d93-ae84-4f68-a6a7-f0c02045169b" containerName="registry" containerID="cri-o://093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc" gracePeriod=30
Oct 30 21:17:29.012008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.011988    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:17:29.140624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140529    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.140624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140595    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.140624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140622    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.140892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140657    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.140892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140706    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.140892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140723    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.140892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140758    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.140892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.140806    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\") pod \"00d37d93-ae84-4f68-a6a7-f0c02045169b\" (UID: \"00d37d93-ae84-4f68-a6a7-f0c02045169b\") "
Oct 30 21:17:29.141116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.141020    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:17:29.141116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.141068    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:17:29.143527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.143495    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:29.143671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.143605    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:29.143671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.143608    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "kube-api-access-hdjj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:29.143791 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.143690    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:29.143791 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.143679    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:29.147911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.147748    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted" pod "00d37d93-ae84-4f68-a6a7-f0c02045169b" (UID: "00d37d93-ae84-4f68-a6a7-f0c02045169b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:29.242085 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242058    4943 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-bound-sa-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.242085 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242083    4943 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-certificates\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.242281 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242093    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdjj5\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-kube-api-access-hdjj5\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.242281 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242102    4943 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00d37d93-ae84-4f68-a6a7-f0c02045169b-trusted-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.242281 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242112    4943 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-installation-pull-secrets\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.242281 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242123    4943 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00d37d93-ae84-4f68-a6a7-f0c02045169b-ca-trust-extracted\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.242281 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242132    4943 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00d37d93-ae84-4f68-a6a7-f0c02045169b-registry-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.242281 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.242141    4943 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00d37d93-ae84-4f68-a6a7-f0c02045169b-image-registry-private-configuration\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:29.856892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.856854    4943 generic.go:356] "Generic (PLEG): container finished" podID="00d37d93-ae84-4f68-a6a7-f0c02045169b" containerID="093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc" exitCode=0
Oct 30 21:17:29.857373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.856900    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6"
Oct 30 21:17:29.857373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.856932    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6" event={"ID":"00d37d93-ae84-4f68-a6a7-f0c02045169b","Type":"ContainerDied","Data":"093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc"}
Oct 30 21:17:29.857373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.856987    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c9745cfc4-b9rb6" event={"ID":"00d37d93-ae84-4f68-a6a7-f0c02045169b","Type":"ContainerDied","Data":"6e139a4b428485d7aeb8ee5274f8bbfbb6005d8aaccecdc9fc9c15dfe3aba24e"}
Oct 30 21:17:29.857373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.857009    4943 scope.go:122] "RemoveContainer" containerID="093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc"
Oct 30 21:17:29.865161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.865145    4943 scope.go:122] "RemoveContainer" containerID="093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc"
Oct 30 21:17:29.865438 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:17:29.865417    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc\": container with ID starting with 093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc not found: ID does not exist" containerID="093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc"
Oct 30 21:17:29.865513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:29.865449    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc"} err="failed to get container status \"093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc\": rpc error: code = NotFound desc = could not find container \"093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc\": container with ID starting with 093aaf6fc0c82087d08fb3c07a57ab894e55e546500b903334b23d2df98fa6bc not found: ID does not exist"
Oct 30 21:17:30.068623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:30.068590    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-c9745cfc4-b9rb6"]
Oct 30 21:17:30.117880 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:30.117853    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-c9745cfc4-b9rb6"]
Oct 30 21:17:31.619133 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:31.619078    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00d37d93-ae84-4f68-a6a7-f0c02045169b" path="/var/lib/kubelet/pods/00d37d93-ae84-4f68-a6a7-f0c02045169b/volumes"
Oct 30 21:17:35.239695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:35.239663    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:35.434384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:35.434354    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:36.259568 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:36.259519    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:36.473933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:36.473904    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:39.739285 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:39.739235    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:39.907431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:39.907396    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:41.177979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:41.177945    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:41.352916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:41.352877    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:45.361801 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:45.361766    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:45.538613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:45.538579    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:45.965408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:45.965378    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:46.144640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:46.144599    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:51.061168 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:17:51.061136    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:17:51.319657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.319604    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs" podUID="a4707941-37b8-49cf-bc81-71a49d4ba37e" containerName="registry" containerID="cri-o://6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad" gracePeriod=30
Oct 30 21:17:51.568345 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.568321    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:17:51.605567 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605509    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.605567 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605543    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.605699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605591    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.605734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605715    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.605821 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605805    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.605865 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605840    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.605911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605878    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.605970 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605918    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\") pod \"a4707941-37b8-49cf-bc81-71a49d4ba37e\" (UID: \"a4707941-37b8-49cf-bc81-71a49d4ba37e\") "
Oct 30 21:17:51.606025 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.605985    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:17:51.606177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.606156    4943 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-trusted-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.607763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.607714    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:17:51.608381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.608354    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "kube-api-access-2rlxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:51.608464 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.608422    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:51.608464 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.608428    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:51.608541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.608484    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:17:51.608698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.608672    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:17:51.613541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.613519    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted" pod "a4707941-37b8-49cf-bc81-71a49d4ba37e" (UID: "a4707941-37b8-49cf-bc81-71a49d4ba37e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:17:51.707311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.707281    4943 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-installation-pull-secrets\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.707311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.707305    4943 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a4707941-37b8-49cf-bc81-71a49d4ba37e-image-registry-private-configuration\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.707311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.707315    4943 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-bound-sa-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.707481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.707324    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rlxf\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-kube-api-access-2rlxf\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.707481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.707333    4943 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-certificates\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.707481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.707342    4943 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a4707941-37b8-49cf-bc81-71a49d4ba37e-registry-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.707481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.707351    4943 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a4707941-37b8-49cf-bc81-71a49d4ba37e-ca-trust-extracted\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:17:51.940188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.940157    4943 generic.go:356] "Generic (PLEG): container finished" podID="2df32282-d6ce-4842-b488-880dcbb49979" containerID="ee2ae4f59f6c4cc8ba2ef2a53522cc7a978e04aae85a23f163fbeac9aceaf74c" exitCode=0
Oct 30 21:17:51.940333 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.940230    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-d7kds" event={"ID":"2df32282-d6ce-4842-b488-880dcbb49979","Type":"ContainerDied","Data":"ee2ae4f59f6c4cc8ba2ef2a53522cc7a978e04aae85a23f163fbeac9aceaf74c"}
Oct 30 21:17:51.940586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.940547    4943 scope.go:122] "RemoveContainer" containerID="ee2ae4f59f6c4cc8ba2ef2a53522cc7a978e04aae85a23f163fbeac9aceaf74c"
Oct 30 21:17:51.941568 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.941535    4943 generic.go:356] "Generic (PLEG): container finished" podID="a4707941-37b8-49cf-bc81-71a49d4ba37e" containerID="6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad" exitCode=0
Oct 30 21:17:51.941690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.941586    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs" event={"ID":"a4707941-37b8-49cf-bc81-71a49d4ba37e","Type":"ContainerDied","Data":"6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad"}
Oct 30 21:17:51.941690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.941613    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs"
Oct 30 21:17:51.941690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.941638    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-675c47d4b7-tznvs" event={"ID":"a4707941-37b8-49cf-bc81-71a49d4ba37e","Type":"ContainerDied","Data":"65b6b751e00d5ae3935ad1549ad0d9af3792d21b80389b55a5b8d9d84c6893e6"}
Oct 30 21:17:51.941690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.941665    4943 scope.go:122] "RemoveContainer" containerID="6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad"
Oct 30 21:17:51.949914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.949893    4943 scope.go:122] "RemoveContainer" containerID="6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad"
Oct 30 21:17:51.950193 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:17:51.950174    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad\": container with ID starting with 6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad not found: ID does not exist" containerID="6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad"
Oct 30 21:17:51.950252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:51.950201    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad"} err="failed to get container status \"6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad\": rpc error: code = NotFound desc = could not find container \"6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad\": container with ID starting with 6316f43920dff00f476383a0ba2f5f67ffe39bd1c83afa5cc0552fbbde4b44ad not found: ID does not exist"
Oct 30 21:17:52.171173 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:52.171139    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-675c47d4b7-tznvs"]
Oct 30 21:17:52.174897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:52.174868    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-675c47d4b7-tznvs"]
Oct 30 21:17:52.946685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:52.946646    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-d7kds" event={"ID":"2df32282-d6ce-4842-b488-880dcbb49979","Type":"ContainerStarted","Data":"b99185a543a32b448d0a550db1050c13ee2cf453422f2286461f900d543bdb80"}
Oct 30 21:17:53.616100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:53.616068    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a4707941-37b8-49cf-bc81-71a49d4ba37e" path="/var/lib/kubelet/pods/a4707941-37b8-49cf-bc81-71a49d4ba37e/volumes"
Oct 30 21:17:54.077356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:54.077322    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:54.254270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:54.254238    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:56.206291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:56.206256    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:56.402598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:56.402570    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:57.807121 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:57.807090    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:17:57.979092 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:17:57.979058    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:01.979938 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:01.979907    4943 generic.go:356] "Generic (PLEG): container finished" podID="1fbe6abd-8922-454f-8ded-4e154da37cbe" containerID="780493962fa3ecbcc715bb085f987974b3cc65acc7f921a7b8fdd957d4630b11" exitCode=0
Oct 30 21:18:01.980297 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:01.979984    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd" event={"ID":"1fbe6abd-8922-454f-8ded-4e154da37cbe","Type":"ContainerDied","Data":"780493962fa3ecbcc715bb085f987974b3cc65acc7f921a7b8fdd957d4630b11"}
Oct 30 21:18:01.980297 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:01.980289    4943 scope.go:122] "RemoveContainer" containerID="780493962fa3ecbcc715bb085f987974b3cc65acc7f921a7b8fdd957d4630b11"
Oct 30 21:18:02.986307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:02.986273    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-h22gd" event={"ID":"1fbe6abd-8922-454f-8ded-4e154da37cbe","Type":"ContainerStarted","Data":"82bf1e586b7c964d4e8ba69ebb3449679939a35cc41cfe4c48925a65af0d5781"}
Oct 30 21:18:04.163469 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:04.163432    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:17.037524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:17.037486    4943 generic.go:356] "Generic (PLEG): container finished" podID="bc5bcf28-7601-411c-a347-80adf8270f94" containerID="5106bd586dd26ec3282c5794fe8cc7f43defe233c41674108336dff25a948bbb" exitCode=0
Oct 30 21:18:17.037963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:17.037541    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22" event={"ID":"bc5bcf28-7601-411c-a347-80adf8270f94","Type":"ContainerDied","Data":"5106bd586dd26ec3282c5794fe8cc7f43defe233c41674108336dff25a948bbb"}
Oct 30 21:18:17.037963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:17.037831    4943 scope.go:122] "RemoveContainer" containerID="5106bd586dd26ec3282c5794fe8cc7f43defe233c41674108336dff25a948bbb"
Oct 30 21:18:18.042462 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:18.042428    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-lzs22" event={"ID":"bc5bcf28-7601-411c-a347-80adf8270f94","Type":"ContainerStarted","Data":"a6747ec6be13cd3e3e7d617b2be4db6e4d4bf87e0ff1592be4cc99cd36d558de"}
Oct 30 21:18:21.062269 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:18:21.062226    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:18:23.354858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:23.354817    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:23.523649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:23.523615    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:30.837360 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:30.837328    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:31.677687 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:31.677653    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:33.479162 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:33.479123    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:33.962785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:33.962755    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:34.136330 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:34.136298    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:36.000147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:36.000106    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:36.171136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:36.171102    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:36.579658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:36.579613    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:41.187149 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:41.187121    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:41.364748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:18:41.364717    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:18:51.060972 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:18:51.060934    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:19:05.343091 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:19:05.343010    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:21.062034 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:19:21.061999    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:19:36.927339 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:19:36.927289    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:19:51.060771 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:19:51.060731    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:20:21.062075 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:20:21.062037    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:20:37.278536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:37.278440    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:37.460629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:37.460596    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:49.450084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:49.450054    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:49.682773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:49.682735    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:50.422317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.422285    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"]
Oct 30 21:20:50.422631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.422616    4943 cpu_manager.go:414] "containerMap: removing container" podUID="00d37d93-ae84-4f68-a6a7-f0c02045169b" containerName="registry"
Oct 30 21:20:50.422720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.422632    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00d37d93-ae84-4f68-a6a7-f0c02045169b" containerName="registry"
Oct 30 21:20:50.422720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.422653    4943 cpu_manager.go:414] "containerMap: removing container" podUID="a4707941-37b8-49cf-bc81-71a49d4ba37e" containerName="registry"
Oct 30 21:20:50.422720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.422658    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a4707941-37b8-49cf-bc81-71a49d4ba37e" containerName="registry"
Oct 30 21:20:50.422720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.422717    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="a4707941-37b8-49cf-bc81-71a49d4ba37e" containerName="registry"
Oct 30 21:20:50.422857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.422728    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="00d37d93-ae84-4f68-a6a7-f0c02045169b" containerName="registry"
Oct 30 21:20:50.425671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.425655    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.470131 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.470099    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twcn7\" (UniqueName: \"kubernetes.io/projected/99a2e52b-e5c4-4aba-a76a-9354d2256340-kube-api-access-twcn7\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.470514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.470158    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.470514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.470295    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.526967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.526935    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 30 21:20:50.526967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.526935    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 30 21:20:50.527150 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.527084    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-h2xqz\""
Oct 30 21:20:50.528170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.528149    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"]
Oct 30 21:20:50.571299 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.571265    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.571469 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.571306    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twcn7\" (UniqueName: \"kubernetes.io/projected/99a2e52b-e5c4-4aba-a76a-9354d2256340-kube-api-access-twcn7\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.571469 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.571345    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.571693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.571673    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.571756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.571682    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.594517 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.594489    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"]
Oct 30 21:20:50.597935 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.597918    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.627741 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.627714    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twcn7\" (UniqueName: \"kubernetes.io/projected/99a2e52b-e5c4-4aba-a76a-9354d2256340-kube-api-access-twcn7\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.656269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.656244    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"]
Oct 30 21:20:50.672215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.672191    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.672357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.672243    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.672357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.672293    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cntq5\" (UniqueName: \"kubernetes.io/projected/b9177c47-2a77-4047-8b35-3c414b824616-kube-api-access-cntq5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.712071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.712043    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-x6l27\""
Oct 30 21:20:50.741291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.741267    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:20:50.773002 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.772977    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.773120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.773007    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cntq5\" (UniqueName: \"kubernetes.io/projected/b9177c47-2a77-4047-8b35-3c414b824616-kube-api-access-cntq5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.773120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.773043    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.773360 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.773345    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.773422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.773401    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.830506 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.830474    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cntq5\" (UniqueName: \"kubernetes.io/projected/b9177c47-2a77-4047-8b35-3c414b824616-kube-api-access-cntq5\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.913694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.913664    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:20:50.915459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:50.915433    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:51.060969 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:20:51.060934    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:20:51.096979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:51.096948    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:51.114723 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:51.114698    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"]
Oct 30 21:20:51.118145 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:51.118122    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a2e52b_e5c4_4aba_a76a_9354d2256340.slice/crio-46a66173da17a0f6c00854affa2d3795eb8f0afac89cd8609a6bcc867bca67a5 WatchSource:0}: Error finding container 46a66173da17a0f6c00854affa2d3795eb8f0afac89cd8609a6bcc867bca67a5: Status 404 returned error can't find the container with id 46a66173da17a0f6c00854affa2d3795eb8f0afac89cd8609a6bcc867bca67a5
Oct 30 21:20:51.282512 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:51.282431    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"]
Oct 30 21:20:51.285746 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:51.285719    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9177c47_2a77_4047_8b35_3c414b824616.slice/crio-5e7405946c08e18daba3b7b25be61712b23bdd8e8777e9bf82e8cf10d7afeed4 WatchSource:0}: Error finding container 5e7405946c08e18daba3b7b25be61712b23bdd8e8777e9bf82e8cf10d7afeed4: Status 404 returned error can't find the container with id 5e7405946c08e18daba3b7b25be61712b23bdd8e8777e9bf82e8cf10d7afeed4
Oct 30 21:20:51.575682 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:51.575592    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj" event={"ID":"99a2e52b-e5c4-4aba-a76a-9354d2256340","Type":"ContainerStarted","Data":"46a66173da17a0f6c00854affa2d3795eb8f0afac89cd8609a6bcc867bca67a5"}
Oct 30 21:20:51.576834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:51.576802    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" event={"ID":"b9177c47-2a77-4047-8b35-3c414b824616","Type":"ContainerStarted","Data":"5e7405946c08e18daba3b7b25be61712b23bdd8e8777e9bf82e8cf10d7afeed4"}
Oct 30 21:20:51.903529 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:51.903501    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:52.826275 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.826238    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"]
Oct 30 21:20:52.830055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.830031    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.889485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.889452    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.889676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.889501    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvjbv\" (UniqueName: \"kubernetes.io/projected/963a5558-d973-4576-af24-7105fa71bfa3-kube-api-access-xvjbv\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.889676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.889536    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.931297 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.931267    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-7fpcc\""
Oct 30 21:20:52.932882 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.932855    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"]
Oct 30 21:20:52.990235 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.990197    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvjbv\" (UniqueName: \"kubernetes.io/projected/963a5558-d973-4576-af24-7105fa71bfa3-kube-api-access-xvjbv\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.990423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.990273    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.990423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.990368    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.990778 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.990759    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:52.990854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:52.990828    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:53.047140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:53.047109    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvjbv\" (UniqueName: \"kubernetes.io/projected/963a5558-d973-4576-af24-7105fa71bfa3-kube-api-access-xvjbv\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:53.149368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:53.149334    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:20:53.535856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:53.535661    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"]
Oct 30 21:20:53.540585 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:53.539383    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod963a5558_d973_4576_af24_7105fa71bfa3.slice/crio-1808da77c485e1bfd64597b3e4ac4f82665ca096b108ec723856550674432fbb WatchSource:0}: Error finding container 1808da77c485e1bfd64597b3e4ac4f82665ca096b108ec723856550674432fbb: Status 404 returned error can't find the container with id 1808da77c485e1bfd64597b3e4ac4f82665ca096b108ec723856550674432fbb
Oct 30 21:20:53.587501 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:53.587465    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls" event={"ID":"963a5558-d973-4576-af24-7105fa71bfa3","Type":"ContainerStarted","Data":"1808da77c485e1bfd64597b3e4ac4f82665ca096b108ec723856550674432fbb"}
Oct 30 21:20:54.209071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.209037    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"]
Oct 30 21:20:54.213846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.213815    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.265364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.265334    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-5x5fg\""
Oct 30 21:20:54.270064 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.269989    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"]
Oct 30 21:20:54.302062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.302025    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npdd\" (UniqueName: \"kubernetes.io/projected/01361d98-397b-4f1a-9c59-db9a7768db93-kube-api-access-2npdd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.302212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.302086    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.302289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.302272    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.308626 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.308602    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"]
Oct 30 21:20:54.312186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.312157    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.365742 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.365700    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-hwkjg\""
Oct 30 21:20:54.369784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.369753    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"]
Oct 30 21:20:54.403269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.403236    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.403426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.403282    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xph6v\" (UniqueName: \"kubernetes.io/projected/6e5da39c-f244-4460-a6de-b049daa11372-kube-api-access-xph6v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.403426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.403333    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.403426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.403369    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2npdd\" (UniqueName: \"kubernetes.io/projected/01361d98-397b-4f1a-9c59-db9a7768db93-kube-api-access-2npdd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.403426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.403408    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.403637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.403441    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.403839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.403822    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.404061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.404047    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.413593 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.412710    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"]
Oct 30 21:20:54.416198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.416178    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.461042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.460974    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npdd\" (UniqueName: \"kubernetes.io/projected/01361d98-397b-4f1a-9c59-db9a7768db93-kube-api-access-2npdd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.473325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.473281    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-7xsxb\""
Oct 30 21:20:54.476334 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.476262    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"]
Oct 30 21:20:54.504650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.504616    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.504800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.504722    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.504800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.504757    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xph6v\" (UniqueName: \"kubernetes.io/projected/6e5da39c-f244-4460-a6de-b049daa11372-kube-api-access-xph6v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.504800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.504787    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.504915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.504818    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdt8l\" (UniqueName: \"kubernetes.io/projected/81b1b722-7f68-49ec-b9ed-1e1a635037e1-kube-api-access-tdt8l\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.504915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.504873    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.505044 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.505015    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.505327 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.505307    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.516671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.516642    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"]
Oct 30 21:20:54.521261 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.521239    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.533136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.533108    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:20:54.571884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.571853    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xph6v\" (UniqueName: \"kubernetes.io/projected/6e5da39c-f244-4460-a6de-b049daa11372-kube-api-access-xph6v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.576307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.575747    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-2b6jw\""
Oct 30 21:20:54.576307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.576244    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"]
Oct 30 21:20:54.616917 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.616883    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.617072 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.616985    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.617072 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.617021    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2x2\" (UniqueName: \"kubernetes.io/projected/98b9268e-605c-4764-ac38-857ee1472b32-kube-api-access-wp2x2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.617072 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.617066    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.617243 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.617117    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.617243 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.617148    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdt8l\" (UniqueName: \"kubernetes.io/projected/81b1b722-7f68-49ec-b9ed-1e1a635037e1-kube-api-access-tdt8l\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.621433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.617864    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.621433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.621327    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.631313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.631285    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:20:54.676443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.676412    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdt8l\" (UniqueName: \"kubernetes.io/projected/81b1b722-7f68-49ec-b9ed-1e1a635037e1-kube-api-access-tdt8l\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.719011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.718668    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.719011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.718721    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2x2\" (UniqueName: \"kubernetes.io/projected/98b9268e-605c-4764-ac38-857ee1472b32-kube-api-access-wp2x2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.719011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.718763    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.720228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.720186    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.720649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.720610    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.733271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.733019    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:20:54.780678 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.780641    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2x2\" (UniqueName: \"kubernetes.io/projected/98b9268e-605c-4764-ac38-857ee1472b32-kube-api-access-wp2x2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.841995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.841959    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:20:54.923386 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:54.923356    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"]
Oct 30 21:20:54.930744 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:54.930709    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01361d98_397b_4f1a_9c59_db9a7768db93.slice/crio-fe441a6b843a69f7253ef9e0eb359a57e46c84ac368bf6b70e8bb8e0a5834293 WatchSource:0}: Error finding container fe441a6b843a69f7253ef9e0eb359a57e46c84ac368bf6b70e8bb8e0a5834293: Status 404 returned error can't find the container with id fe441a6b843a69f7253ef9e0eb359a57e46c84ac368bf6b70e8bb8e0a5834293
Oct 30 21:20:55.026638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:55.026128    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"]
Oct 30 21:20:55.030749 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:55.030712    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5da39c_f244_4460_a6de_b049daa11372.slice/crio-11eb1d8c976be4cb4a8e92b7d69aaa093a191955ce4c0342af02fb9490407b26 WatchSource:0}: Error finding container 11eb1d8c976be4cb4a8e92b7d69aaa093a191955ce4c0342af02fb9490407b26: Status 404 returned error can't find the container with id 11eb1d8c976be4cb4a8e92b7d69aaa093a191955ce4c0342af02fb9490407b26
Oct 30 21:20:55.134896 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:55.134778    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"]
Oct 30 21:20:55.140256 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:55.140206    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b1b722_7f68_49ec_b9ed_1e1a635037e1.slice/crio-3cbd307ab127b904b157331d784fd349d0342d8d9af143306c4e3c02971908f2 WatchSource:0}: Error finding container 3cbd307ab127b904b157331d784fd349d0342d8d9af143306c4e3c02971908f2: Status 404 returned error can't find the container with id 3cbd307ab127b904b157331d784fd349d0342d8d9af143306c4e3c02971908f2
Oct 30 21:20:55.236393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:55.235385    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"]
Oct 30 21:20:55.599407 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:55.599367    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw" event={"ID":"98b9268e-605c-4764-ac38-857ee1472b32","Type":"ContainerStarted","Data":"5c65bf601bad074b9ce2584dd6df1bf22b214c7f8232b8b9aad8180f5df52dda"}
Oct 30 21:20:55.601266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:55.601215    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6" event={"ID":"01361d98-397b-4f1a-9c59-db9a7768db93","Type":"ContainerStarted","Data":"fe441a6b843a69f7253ef9e0eb359a57e46c84ac368bf6b70e8bb8e0a5834293"}
Oct 30 21:20:55.604014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:55.603983    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6" event={"ID":"6e5da39c-f244-4460-a6de-b049daa11372","Type":"ContainerStarted","Data":"11eb1d8c976be4cb4a8e92b7d69aaa093a191955ce4c0342af02fb9490407b26"}
Oct 30 21:20:55.607138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:55.607095    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth" event={"ID":"81b1b722-7f68-49ec-b9ed-1e1a635037e1","Type":"ContainerStarted","Data":"3cbd307ab127b904b157331d784fd349d0342d8d9af143306c4e3c02971908f2"}
Oct 30 21:20:56.412733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.412699    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"]
Oct 30 21:20:56.417804 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.417777    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.442260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.442232    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2z9w\" (UniqueName: \"kubernetes.io/projected/90154674-3eb6-47f6-8a64-f49c3d53c540-kube-api-access-c2z9w\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.442434 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.442311    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.442434 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.442410    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.523283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.523185    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"]
Oct 30 21:20:56.543611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.543544    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2z9w\" (UniqueName: \"kubernetes.io/projected/90154674-3eb6-47f6-8a64-f49c3d53c540-kube-api-access-c2z9w\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.543776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.543656    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.543776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.543690    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.544140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.544115    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.544731 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.544707    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.604285 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.604168    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2z9w\" (UniqueName: \"kubernetes.io/projected/90154674-3eb6-47f6-8a64-f49c3d53c540-kube-api-access-c2z9w\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.715481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.715394    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"]
Oct 30 21:20:56.719777 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.719681    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.738566 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.738526    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:20:56.745463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.745432    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.745697 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.745673    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.745783 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.745717    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4t9j\" (UniqueName: \"kubernetes.io/projected/c1514bd1-41e1-430b-b6ef-0a74e056e551-kube-api-access-x4t9j\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.762514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.762465    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:56.782594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.776716    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"]
Oct 30 21:20:56.846729 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.846678    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.847435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.846111    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.847435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.846973    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4t9j\" (UniqueName: \"kubernetes.io/projected/c1514bd1-41e1-430b-b6ef-0a74e056e551-kube-api-access-x4t9j\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.847435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.847012    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.847435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.847329    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:56.915531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:56.915498    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4t9j\" (UniqueName: \"kubernetes.io/projected/c1514bd1-41e1-430b-b6ef-0a74e056e551-kube-api-access-x4t9j\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:57.012915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.012818    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:57.042601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.042567    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:20:57.130170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.130141    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"]
Oct 30 21:20:57.161002 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:57.160967    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90154674_3eb6_47f6_8a64_f49c3d53c540.slice/crio-aff87518eaef99134dccfa68e9797d012f57b7257296a705d2e800b0689c092d WatchSource:0}: Error finding container aff87518eaef99134dccfa68e9797d012f57b7257296a705d2e800b0689c092d: Status 404 returned error can't find the container with id aff87518eaef99134dccfa68e9797d012f57b7257296a705d2e800b0689c092d
Oct 30 21:20:57.450828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.450789    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"]
Oct 30 21:20:57.455145 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:57.455109    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1514bd1_41e1_430b_b6ef_0a74e056e551.slice/crio-c536d557d8fac76f420e2491e74969c2fdc68d6004ccfb997011562b3a165c8a WatchSource:0}: Error finding container c536d557d8fac76f420e2491e74969c2fdc68d6004ccfb997011562b3a165c8a: Status 404 returned error can't find the container with id c536d557d8fac76f420e2491e74969c2fdc68d6004ccfb997011562b3a165c8a
Oct 30 21:20:57.635356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.635310    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f" event={"ID":"90154674-3eb6-47f6-8a64-f49c3d53c540","Type":"ContainerStarted","Data":"aff87518eaef99134dccfa68e9797d012f57b7257296a705d2e800b0689c092d"}
Oct 30 21:20:57.638661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.638616    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb" event={"ID":"c1514bd1-41e1-430b-b6ef-0a74e056e551","Type":"ContainerStarted","Data":"c536d557d8fac76f420e2491e74969c2fdc68d6004ccfb997011562b3a165c8a"}
Oct 30 21:20:57.684171 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.684139    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"]
Oct 30 21:20:57.688813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.688790    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.745245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.745157    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-x8rmh\""
Oct 30 21:20:57.747256 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.747233    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.750824    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"]
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756310    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756358    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756395    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756440    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756478    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756515    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3788014-47c8-491d-8f92-18bf1b08c7d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756539    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vxpp\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-kube-api-access-9vxpp\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756588    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.760812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.756618    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.823155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.823081    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:57.857528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857486    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857546    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857601    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857646    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857676    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857700    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3788014-47c8-491d-8f92-18bf1b08c7d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857720    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vxpp\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-kube-api-access-9vxpp\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857747    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.857992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.857764    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.858210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.858128    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.858895 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.858865    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.859751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.859641    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3788014-47c8-491d-8f92-18bf1b08c7d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.859977 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.859958    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.860057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.859993    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.862535 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.862503    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.875783 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.875705    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.920406 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.920372    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:57.920549 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:57.920385    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vxpp\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-kube-api-access-9vxpp\") pod \"maas-default-gateway-openshift-default-7f694df8bc-fcgrc\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:58.005528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.000095    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"]
Oct 30 21:20:58.009652 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.009380    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:20:58.014633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.014253    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.059540    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"]
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060058    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/501d7ec4-1e74-452b-a771-8acfad8bd664-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060136    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060163    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060192    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060229    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060263    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060304    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060327    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f64dq\" (UniqueName: \"kubernetes.io/projected/501d7ec4-1e74-452b-a771-8acfad8bd664-kube-api-access-f64dq\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.060621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.060383    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.066500 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.065835    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-nlj8w\""
Oct 30 21:20:58.135369 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.135338    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161065    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/501d7ec4-1e74-452b-a771-8acfad8bd664-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161115    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161145    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161176    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161206    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161243    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161291    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161320    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f64dq\" (UniqueName: \"kubernetes.io/projected/501d7ec4-1e74-452b-a771-8acfad8bd664-kube-api-access-f64dq\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.161941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.161387    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.165179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.163388    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.165179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.164359    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/501d7ec4-1e74-452b-a771-8acfad8bd664-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.165179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.164701    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.165179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.164930    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.165179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.165174    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.167932 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.167824    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.168575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.168529    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.219581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.219129    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f64dq\" (UniqueName: \"kubernetes.io/projected/501d7ec4-1e74-452b-a771-8acfad8bd664-kube-api-access-f64dq\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.220265 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.220191    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/501d7ec4-1e74-452b-a771-8acfad8bd664-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq\" (UID: \"501d7ec4-1e74-452b-a771-8acfad8bd664\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.300848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.300762    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:20:58.337633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.337595    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:20:58.449267 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.449234    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"]
Oct 30 21:20:58.662568 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.662515    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" event={"ID":"b3788014-47c8-491d-8f92-18bf1b08c7d3","Type":"ContainerStarted","Data":"ef0251cb2056dc2f3333ec3fe3c0e7b7918ac9d3837cce480fcb90dd20bb301b"}
Oct 30 21:20:58.751824 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:58.751654    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"]
Oct 30 21:20:58.763539 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:20:58.763398    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501d7ec4_1e74_452b_a771_8acfad8bd664.slice/crio-ac47a215fe2b301edf9e4d87777a68b26325f040d342340e22d9d4de28e5927f WatchSource:0}: Error finding container ac47a215fe2b301edf9e4d87777a68b26325f040d342340e22d9d4de28e5927f: Status 404 returned error can't find the container with id ac47a215fe2b301edf9e4d87777a68b26325f040d342340e22d9d4de28e5927f
Oct 30 21:20:59.679300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:20:59.679268    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq" event={"ID":"501d7ec4-1e74-452b-a771-8acfad8bd664","Type":"ContainerStarted","Data":"ac47a215fe2b301edf9e4d87777a68b26325f040d342340e22d9d4de28e5927f"}
Oct 30 21:21:01.974489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:01.974408    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:05.293349 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:05.293217    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:05.470076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:05.470042    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:06.762440 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:06.762406    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" event={"ID":"b9177c47-2a77-4047-8b35-3c414b824616","Type":"ContainerStarted","Data":"a4790d2c4b12cc7d4389ff52f4b47ecbd0a36e6c090bfc1df7fc74e0cfcfeb3b"}
Oct 30 21:21:06.768800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:06.768508    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6" event={"ID":"01361d98-397b-4f1a-9c59-db9a7768db93","Type":"ContainerStarted","Data":"8bf758e662a0de6ccc37b8e7463acac84e31a462a0cb44871120d52f1ac2e6f5"}
Oct 30 21:21:07.777369 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.777330    4943 generic.go:356] "Generic (PLEG): container finished" podID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerID="6fa9417b00563ec6034cdda4f993ce76e20c5ce5ed12a26f3f6a7f433112d613" exitCode=0
Oct 30 21:21:07.777745 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.777444    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj" event={"ID":"99a2e52b-e5c4-4aba-a76a-9354d2256340","Type":"ContainerDied","Data":"6fa9417b00563ec6034cdda4f993ce76e20c5ce5ed12a26f3f6a7f433112d613"}
Oct 30 21:21:07.784239 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.784209    4943 generic.go:356] "Generic (PLEG): container finished" podID="b9177c47-2a77-4047-8b35-3c414b824616" containerID="a4790d2c4b12cc7d4389ff52f4b47ecbd0a36e6c090bfc1df7fc74e0cfcfeb3b" exitCode=0
Oct 30 21:21:07.784335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.784290    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" event={"ID":"b9177c47-2a77-4047-8b35-3c414b824616","Type":"ContainerDied","Data":"a4790d2c4b12cc7d4389ff52f4b47ecbd0a36e6c090bfc1df7fc74e0cfcfeb3b"}
Oct 30 21:21:07.786812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.786790    4943 generic.go:356] "Generic (PLEG): container finished" podID="98b9268e-605c-4764-ac38-857ee1472b32" containerID="ac07ad66bb0b553b065da9ee2b1d69f0c736cb2c6c57f9b76e512836e06e3694" exitCode=0
Oct 30 21:21:07.786915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.786845    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw" event={"ID":"98b9268e-605c-4764-ac38-857ee1472b32","Type":"ContainerDied","Data":"ac07ad66bb0b553b065da9ee2b1d69f0c736cb2c6c57f9b76e512836e06e3694"}
Oct 30 21:21:07.794589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.794383    4943 generic.go:356] "Generic (PLEG): container finished" podID="01361d98-397b-4f1a-9c59-db9a7768db93" containerID="8bf758e662a0de6ccc37b8e7463acac84e31a462a0cb44871120d52f1ac2e6f5" exitCode=0
Oct 30 21:21:07.796161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.794538    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6" event={"ID":"01361d98-397b-4f1a-9c59-db9a7768db93","Type":"ContainerDied","Data":"8bf758e662a0de6ccc37b8e7463acac84e31a462a0cb44871120d52f1ac2e6f5"}
Oct 30 21:21:07.800144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.800084    4943 generic.go:356] "Generic (PLEG): container finished" podID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerID="c65a6c473f252a279069f4bacd3ec65facae3513fc9c49a5bdff31596639d890" exitCode=0
Oct 30 21:21:07.800144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:07.800142    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth" event={"ID":"81b1b722-7f68-49ec-b9ed-1e1a635037e1","Type":"ContainerDied","Data":"c65a6c473f252a279069f4bacd3ec65facae3513fc9c49a5bdff31596639d890"}
Oct 30 21:21:08.246475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.246435    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:08.246626 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.246525    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:08.246688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.246645    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:08.365268 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.365226    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:08.365361 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.365324    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:08.365405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.365367    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:21:08.806942 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.806847    4943 generic.go:356] "Generic (PLEG): container finished" podID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerID="ed83979292b7aade744e94a9d6aceeb4c3668291ae4d6fb6d1a6e92e4d278ded" exitCode=0
Oct 30 21:21:08.807372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.806942    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb" event={"ID":"c1514bd1-41e1-430b-b6ef-0a74e056e551","Type":"ContainerDied","Data":"ed83979292b7aade744e94a9d6aceeb4c3668291ae4d6fb6d1a6e92e4d278ded"}
Oct 30 21:21:08.809252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.809224    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" event={"ID":"b3788014-47c8-491d-8f92-18bf1b08c7d3","Type":"ContainerStarted","Data":"0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273"}
Oct 30 21:21:08.811099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.811071    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq" event={"ID":"501d7ec4-1e74-452b-a771-8acfad8bd664","Type":"ContainerStarted","Data":"c73eedf4f30e1844c8acb72b6dfacbb236bd2bd3e6d5a790602e8a062f3aaf8a"}
Oct 30 21:21:08.813163 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.813138    4943 generic.go:356] "Generic (PLEG): container finished" podID="b9177c47-2a77-4047-8b35-3c414b824616" containerID="2e25318b589bba1ca774ef2d72893e524d7faf131581e02b66ad3a4ebf4f6114" exitCode=0
Oct 30 21:21:08.813287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.813222    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" event={"ID":"b9177c47-2a77-4047-8b35-3c414b824616","Type":"ContainerDied","Data":"2e25318b589bba1ca774ef2d72893e524d7faf131581e02b66ad3a4ebf4f6114"}
Oct 30 21:21:08.815040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.815017    4943 generic.go:356] "Generic (PLEG): container finished" podID="6e5da39c-f244-4460-a6de-b049daa11372" containerID="afa59303cd7c969d50bb2a33644937b929287a1e9cb8fc8e3d5e3599d3326b52" exitCode=0
Oct 30 21:21:08.815166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.815095    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6" event={"ID":"6e5da39c-f244-4460-a6de-b049daa11372","Type":"ContainerDied","Data":"afa59303cd7c969d50bb2a33644937b929287a1e9cb8fc8e3d5e3599d3326b52"}
Oct 30 21:21:08.816854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.816836    4943 generic.go:356] "Generic (PLEG): container finished" podID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerID="727bd7dd3279a21a89dcf67dd98f949dd61339685b55120141ec9e052dc036cb" exitCode=0
Oct 30 21:21:08.816946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:08.816877    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f" event={"ID":"90154674-3eb6-47f6-8a64-f49c3d53c540","Type":"ContainerDied","Data":"727bd7dd3279a21a89dcf67dd98f949dd61339685b55120141ec9e052dc036cb"}
Oct 30 21:21:09.009946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.009912    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:21:09.014486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.014461    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:21:09.153445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.153384    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" podStartSLOduration=2.368764569 podStartE2EDuration="12.153370077s" totalImagesPullingTime="9.784605508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:09.151722695 +0000 UTC m=+263.647296046" watchObservedRunningTime="2026-10-30 21:21:09.153370077 +0000 UTC m=+263.648943427"
Oct 30 21:21:09.269402 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.269346    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq" podStartSLOduration=2.6746100029999997 podStartE2EDuration="12.269330354s" totalImagesPullingTime="9.594720351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:09.26704465 +0000 UTC m=+263.762618030" watchObservedRunningTime="2026-10-30 21:21:09.269330354 +0000 UTC m=+263.764903705"
Oct 30 21:21:09.338283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.338251    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:21:09.343090 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.343042    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:21:09.825109 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.825075    4943 generic.go:356] "Generic (PLEG): container finished" podID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerID="61c1eea4f84630f1875220257660fabb5ea6bc2aa5e891a963ef62f7b022fe88" exitCode=0
Oct 30 21:21:09.825684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.825111    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth" event={"ID":"81b1b722-7f68-49ec-b9ed-1e1a635037e1","Type":"ContainerDied","Data":"61c1eea4f84630f1875220257660fabb5ea6bc2aa5e891a963ef62f7b022fe88"}
Oct 30 21:21:09.827055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.827029    4943 generic.go:356] "Generic (PLEG): container finished" podID="963a5558-d973-4576-af24-7105fa71bfa3" containerID="053a6e48177fd28638869a321924d11a7c0df78a7d5f0b595952d5cbf8a6b3bc" exitCode=0
Oct 30 21:21:09.827161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.827101    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls" event={"ID":"963a5558-d973-4576-af24-7105fa71bfa3","Type":"ContainerDied","Data":"053a6e48177fd28638869a321924d11a7c0df78a7d5f0b595952d5cbf8a6b3bc"}
Oct 30 21:21:09.830837 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.830814    4943 generic.go:356] "Generic (PLEG): container finished" podID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerID="e7fcdcad1203b165e0d117817bc4148435df01823fc03e5ff2c9ee9c2c3ad12c" exitCode=0
Oct 30 21:21:09.831093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.831071    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb" event={"ID":"c1514bd1-41e1-430b-b6ef-0a74e056e551","Type":"ContainerDied","Data":"e7fcdcad1203b165e0d117817bc4148435df01823fc03e5ff2c9ee9c2c3ad12c"}
Oct 30 21:21:09.833674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.833304    4943 generic.go:356] "Generic (PLEG): container finished" podID="98b9268e-605c-4764-ac38-857ee1472b32" containerID="c781498e38308026ba4a90c424dee07ba5bcd990f8ccc8ee5df49d10391c3fc1" exitCode=0
Oct 30 21:21:09.833674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.833376    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw" event={"ID":"98b9268e-605c-4764-ac38-857ee1472b32","Type":"ContainerDied","Data":"c781498e38308026ba4a90c424dee07ba5bcd990f8ccc8ee5df49d10391c3fc1"}
Oct 30 21:21:09.836779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.836759    4943 generic.go:356] "Generic (PLEG): container finished" podID="01361d98-397b-4f1a-9c59-db9a7768db93" containerID="5e322269289322ab34ea25a3f53d1cb512528ac6652558339b3c813de399ef48" exitCode=0
Oct 30 21:21:09.836875 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.836854    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6" event={"ID":"01361d98-397b-4f1a-9c59-db9a7768db93","Type":"ContainerDied","Data":"5e322269289322ab34ea25a3f53d1cb512528ac6652558339b3c813de399ef48"}
Oct 30 21:21:09.837593 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.837299    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:21:09.837593 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.837341    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:21:09.838445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.838418    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq"
Oct 30 21:21:09.838770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:09.838728    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:21:10.854198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:10.854156    4943 generic.go:356] "Generic (PLEG): container finished" podID="6e5da39c-f244-4460-a6de-b049daa11372" containerID="4aa7dfd4c0a16979dd94ef14b0cbff724c7d9aa34eb193cbd0a952ea68475129" exitCode=0
Oct 30 21:21:10.855118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:10.854997    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6" event={"ID":"6e5da39c-f244-4460-a6de-b049daa11372","Type":"ContainerDied","Data":"4aa7dfd4c0a16979dd94ef14b0cbff724c7d9aa34eb193cbd0a952ea68475129"}
Oct 30 21:21:12.880181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:12.879102    4943 generic.go:356] "Generic (PLEG): container finished" podID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerID="b9532f6b8b1e2e3d824970dd6714e09dfd028efcec29bcf927c117eba06baaee" exitCode=0
Oct 30 21:21:12.880181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:12.879196    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj" event={"ID":"99a2e52b-e5c4-4aba-a76a-9354d2256340","Type":"ContainerDied","Data":"b9532f6b8b1e2e3d824970dd6714e09dfd028efcec29bcf927c117eba06baaee"}
Oct 30 21:21:15.923546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:15.923501    4943 generic.go:356] "Generic (PLEG): container finished" podID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerID="9e20f2b0666c731eb14eadfdc0344dedefdaab7f68c4210d8ca58f13b2d48617" exitCode=0
Oct 30 21:21:15.924059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:15.923603    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f" event={"ID":"90154674-3eb6-47f6-8a64-f49c3d53c540","Type":"ContainerDied","Data":"9e20f2b0666c731eb14eadfdc0344dedefdaab7f68c4210d8ca58f13b2d48617"}
Oct 30 21:21:17.959896 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:17.958719    4943 generic.go:356] "Generic (PLEG): container finished" podID="963a5558-d973-4576-af24-7105fa71bfa3" containerID="f24272abf488563388de1944eeb419a86f9c5ae6bdc6f73bfa49feb2aa037bea" exitCode=0
Oct 30 21:21:17.959896 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:17.958818    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls" event={"ID":"963a5558-d973-4576-af24-7105fa71bfa3","Type":"ContainerDied","Data":"f24272abf488563388de1944eeb419a86f9c5ae6bdc6f73bfa49feb2aa037bea"}
Oct 30 21:21:21.133449 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:21:21.133349    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:21:27.072139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:27.072097    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" event={"ID":"b9177c47-2a77-4047-8b35-3c414b824616","Type":"ContainerStarted","Data":"fbd084e370ce75908a1404037d3f3876533cc9883f1bea5353828cfa3471e3df"}
Oct 30 21:21:27.188967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:27.188903    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" podStartSLOduration=3.095378309 podStartE2EDuration="37.188882548s" totalImagesPullingTime="34.093504239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:27.188166476 +0000 UTC m=+281.683739820" watchObservedRunningTime="2026-10-30 21:21:27.188882548 +0000 UTC m=+281.684455902"
Oct 30 21:21:28.088704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:28.088610    4943 generic.go:356] "Generic (PLEG): container finished" podID="b9177c47-2a77-4047-8b35-3c414b824616" containerID="fbd084e370ce75908a1404037d3f3876533cc9883f1bea5353828cfa3471e3df" exitCode=0
Oct 30 21:21:28.089180 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:28.088830    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" event={"ID":"b9177c47-2a77-4047-8b35-3c414b824616","Type":"ContainerDied","Data":"fbd084e370ce75908a1404037d3f3876533cc9883f1bea5353828cfa3471e3df"}
Oct 30 21:21:28.092646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:28.092612    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f" event={"ID":"90154674-3eb6-47f6-8a64-f49c3d53c540","Type":"ContainerStarted","Data":"8cf9b66d20a420ef7bf2a0b31c874a94ca655acc0c0610c4bf462884ab50070d"}
Oct 30 21:21:28.321439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:28.319264    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f" podStartSLOduration=3.19728652 podStartE2EDuration="32.319243834s" totalImagesPullingTime="29.121957314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:28.31859832 +0000 UTC m=+282.814171672" watchObservedRunningTime="2026-10-30 21:21:28.319243834 +0000 UTC m=+282.814817189"
Oct 30 21:21:29.099022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.098994    4943 generic.go:356] "Generic (PLEG): container finished" podID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerID="8cf9b66d20a420ef7bf2a0b31c874a94ca655acc0c0610c4bf462884ab50070d" exitCode=0
Oct 30 21:21:29.099373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.099093    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f" event={"ID":"90154674-3eb6-47f6-8a64-f49c3d53c540","Type":"ContainerDied","Data":"8cf9b66d20a420ef7bf2a0b31c874a94ca655acc0c0610c4bf462884ab50070d"}
Oct 30 21:21:29.101402 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.101379    4943 generic.go:356] "Generic (PLEG): container finished" podID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerID="2c6609b9d2b659d251a9f5305c347dd00e52c5d1e12d86e443367b3c853b09a2" exitCode=0
Oct 30 21:21:29.101511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.101460    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth" event={"ID":"81b1b722-7f68-49ec-b9ed-1e1a635037e1","Type":"ContainerDied","Data":"2c6609b9d2b659d251a9f5305c347dd00e52c5d1e12d86e443367b3c853b09a2"}
Oct 30 21:21:29.105686 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.105172    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb" event={"ID":"c1514bd1-41e1-430b-b6ef-0a74e056e551","Type":"ContainerStarted","Data":"b05828c9466f933199de279ab6d95433fd41342522f167ac8aae0c9e3bd43066"}
Oct 30 21:21:29.107426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.107404    4943 generic.go:356] "Generic (PLEG): container finished" podID="01361d98-397b-4f1a-9c59-db9a7768db93" containerID="025b1ecd9880370286958d331411dde9e4a4f4136f7f4eac5541844214efc4d0" exitCode=0
Oct 30 21:21:29.107521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.107430    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6" event={"ID":"01361d98-397b-4f1a-9c59-db9a7768db93","Type":"ContainerDied","Data":"025b1ecd9880370286958d331411dde9e4a4f4136f7f4eac5541844214efc4d0"}
Oct 30 21:21:29.248687 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.248661    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:21:29.329649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.329536    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb" podStartSLOduration=2.733239002 podStartE2EDuration="33.329517103s" totalImagesPullingTime="30.596278101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:29.328484921 +0000 UTC m=+283.824058274" watchObservedRunningTime="2026-10-30 21:21:29.329517103 +0000 UTC m=+283.825090453"
Oct 30 21:21:29.380102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.380063    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-util\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-util\") pod \"b9177c47-2a77-4047-8b35-3c414b824616\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") "
Oct 30 21:21:29.380289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.380126    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-bundle\") pod \"b9177c47-2a77-4047-8b35-3c414b824616\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") "
Oct 30 21:21:29.380289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.380168    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9177c47-2a77-4047-8b35-3c414b824616-kube-api-access-cntq5\" (UniqueName: \"kubernetes.io/projected/b9177c47-2a77-4047-8b35-3c414b824616-kube-api-access-cntq5\") pod \"b9177c47-2a77-4047-8b35-3c414b824616\" (UID: \"b9177c47-2a77-4047-8b35-3c414b824616\") "
Oct 30 21:21:29.381309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.381279    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-bundle" pod "b9177c47-2a77-4047-8b35-3c414b824616" (UID: "b9177c47-2a77-4047-8b35-3c414b824616"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:29.383051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.383018    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9177c47-2a77-4047-8b35-3c414b824616-kube-api-access-cntq5" pod "b9177c47-2a77-4047-8b35-3c414b824616" (UID: "b9177c47-2a77-4047-8b35-3c414b824616"). InnerVolumeSpecName "kube-api-access-cntq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:29.386310 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.386284    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-util" pod "b9177c47-2a77-4047-8b35-3c414b824616" (UID: "b9177c47-2a77-4047-8b35-3c414b824616"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:29.481047 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.481020    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:29.481047 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.481046    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9177c47-2a77-4047-8b35-3c414b824616-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:29.481235 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:29.481056    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cntq5\" (UniqueName: \"kubernetes.io/projected/b9177c47-2a77-4047-8b35-3c414b824616-kube-api-access-cntq5\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.114942 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.114904    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj" event={"ID":"99a2e52b-e5c4-4aba-a76a-9354d2256340","Type":"ContainerStarted","Data":"fd72298e4ff911ad75459d9dbbc1a6169774868dac2a9e62c698a4af9b1351f3"}
Oct 30 21:21:30.117255 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.117228    4943 generic.go:356] "Generic (PLEG): container finished" podID="963a5558-d973-4576-af24-7105fa71bfa3" containerID="3c65af9c2e59eb53debb7e607b714623c403a0169cc017864ed0e4d5b252a593" exitCode=0
Oct 30 21:21:30.117374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.117304    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls" event={"ID":"963a5558-d973-4576-af24-7105fa71bfa3","Type":"ContainerDied","Data":"3c65af9c2e59eb53debb7e607b714623c403a0169cc017864ed0e4d5b252a593"}
Oct 30 21:21:30.119270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.119250    4943 generic.go:356] "Generic (PLEG): container finished" podID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerID="b05828c9466f933199de279ab6d95433fd41342522f167ac8aae0c9e3bd43066" exitCode=0
Oct 30 21:21:30.119345 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.119327    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb" event={"ID":"c1514bd1-41e1-430b-b6ef-0a74e056e551","Type":"ContainerDied","Data":"b05828c9466f933199de279ab6d95433fd41342522f167ac8aae0c9e3bd43066"}
Oct 30 21:21:30.121067 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.121043    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895" event={"ID":"b9177c47-2a77-4047-8b35-3c414b824616","Type":"ContainerDied","Data":"5e7405946c08e18daba3b7b25be61712b23bdd8e8777e9bf82e8cf10d7afeed4"}
Oct 30 21:21:30.121283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.121080    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e7405946c08e18daba3b7b25be61712b23bdd8e8777e9bf82e8cf10d7afeed4"
Oct 30 21:21:30.121283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.121051    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71gk895"
Oct 30 21:21:30.123250 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.123226    4943 generic.go:356] "Generic (PLEG): container finished" podID="98b9268e-605c-4764-ac38-857ee1472b32" containerID="60acc30bdb93fd6c19b9399b861c724de6d5eb85978d14b30378311fde18a13c" exitCode=0
Oct 30 21:21:30.123362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.123340    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw" event={"ID":"98b9268e-605c-4764-ac38-857ee1472b32","Type":"ContainerDied","Data":"60acc30bdb93fd6c19b9399b861c724de6d5eb85978d14b30378311fde18a13c"}
Oct 30 21:21:30.125241 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.125222    4943 generic.go:356] "Generic (PLEG): container finished" podID="6e5da39c-f244-4460-a6de-b049daa11372" containerID="bd75f81d5da1fbf00e577d3d4f498b978d5c66da6f2ad6ae91d7ce92d7ad5783" exitCode=0
Oct 30 21:21:30.125329 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.125308    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6" event={"ID":"6e5da39c-f244-4460-a6de-b049daa11372","Type":"ContainerDied","Data":"bd75f81d5da1fbf00e577d3d4f498b978d5c66da6f2ad6ae91d7ce92d7ad5783"}
Oct 30 21:21:30.229473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.229415    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj" podStartSLOduration=2.297558746 podStartE2EDuration="40.229397266s" totalImagesPullingTime="37.93183852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:20:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:30.228846702 +0000 UTC m=+284.724420067" watchObservedRunningTime="2026-10-30 21:21:30.229397266 +0000 UTC m=+284.724970614"
Oct 30 21:21:30.251173 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.251146    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:21:30.275813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.275767    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:21:30.303837 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.303816    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:21:30.390150 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390119    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-util\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-util\") pod \"01361d98-397b-4f1a-9c59-db9a7768db93\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") "
Oct 30 21:21:30.390284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390165    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-bundle\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-bundle\") pod \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") "
Oct 30 21:21:30.390284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390207    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-util\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-util\") pod \"90154674-3eb6-47f6-8a64-f49c3d53c540\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") "
Oct 30 21:21:30.390284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390244    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01361d98-397b-4f1a-9c59-db9a7768db93-kube-api-access-2npdd\" (UniqueName: \"kubernetes.io/projected/01361d98-397b-4f1a-9c59-db9a7768db93-kube-api-access-2npdd\") pod \"01361d98-397b-4f1a-9c59-db9a7768db93\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") "
Oct 30 21:21:30.390418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390302    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/90154674-3eb6-47f6-8a64-f49c3d53c540-kube-api-access-c2z9w\" (UniqueName: \"kubernetes.io/projected/90154674-3eb6-47f6-8a64-f49c3d53c540-kube-api-access-c2z9w\") pod \"90154674-3eb6-47f6-8a64-f49c3d53c540\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") "
Oct 30 21:21:30.390418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390353    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-util\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-util\") pod \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") "
Oct 30 21:21:30.390528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390490    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-bundle\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-bundle\") pod \"90154674-3eb6-47f6-8a64-f49c3d53c540\" (UID: \"90154674-3eb6-47f6-8a64-f49c3d53c540\") "
Oct 30 21:21:30.390609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390596    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-bundle\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-bundle\") pod \"01361d98-397b-4f1a-9c59-db9a7768db93\" (UID: \"01361d98-397b-4f1a-9c59-db9a7768db93\") "
Oct 30 21:21:30.390671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390632    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81b1b722-7f68-49ec-b9ed-1e1a635037e1-kube-api-access-tdt8l\" (UniqueName: \"kubernetes.io/projected/81b1b722-7f68-49ec-b9ed-1e1a635037e1-kube-api-access-tdt8l\") pod \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\" (UID: \"81b1b722-7f68-49ec-b9ed-1e1a635037e1\") "
Oct 30 21:21:30.390845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390813    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-bundle" pod "81b1b722-7f68-49ec-b9ed-1e1a635037e1" (UID: "81b1b722-7f68-49ec-b9ed-1e1a635037e1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:30.391509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.390927    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.391509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.391440    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-bundle" pod "01361d98-397b-4f1a-9c59-db9a7768db93" (UID: "01361d98-397b-4f1a-9c59-db9a7768db93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:30.391710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.391679    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-bundle" pod "90154674-3eb6-47f6-8a64-f49c3d53c540" (UID: "90154674-3eb6-47f6-8a64-f49c3d53c540"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:30.392722 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.392697    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01361d98-397b-4f1a-9c59-db9a7768db93-kube-api-access-2npdd" pod "01361d98-397b-4f1a-9c59-db9a7768db93" (UID: "01361d98-397b-4f1a-9c59-db9a7768db93"). InnerVolumeSpecName "kube-api-access-2npdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:30.392903 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.392878    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90154674-3eb6-47f6-8a64-f49c3d53c540-kube-api-access-c2z9w" pod "90154674-3eb6-47f6-8a64-f49c3d53c540" (UID: "90154674-3eb6-47f6-8a64-f49c3d53c540"). InnerVolumeSpecName "kube-api-access-c2z9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:30.393120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.393104    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81b1b722-7f68-49ec-b9ed-1e1a635037e1-kube-api-access-tdt8l" pod "81b1b722-7f68-49ec-b9ed-1e1a635037e1" (UID: "81b1b722-7f68-49ec-b9ed-1e1a635037e1"). InnerVolumeSpecName "kube-api-access-tdt8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:30.397877 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.397853    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-util" pod "90154674-3eb6-47f6-8a64-f49c3d53c540" (UID: "90154674-3eb6-47f6-8a64-f49c3d53c540"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:30.398881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.398857    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-util" pod "01361d98-397b-4f1a-9c59-db9a7768db93" (UID: "01361d98-397b-4f1a-9c59-db9a7768db93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:30.398996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.398981    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-util" pod "81b1b722-7f68-49ec-b9ed-1e1a635037e1" (UID: "81b1b722-7f68-49ec-b9ed-1e1a635037e1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:30.491921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491900    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2z9w\" (UniqueName: \"kubernetes.io/projected/90154674-3eb6-47f6-8a64-f49c3d53c540-kube-api-access-c2z9w\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.491921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491921    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81b1b722-7f68-49ec-b9ed-1e1a635037e1-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.492036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491931    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.492036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491939    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.492036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491948    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdt8l\" (UniqueName: \"kubernetes.io/projected/81b1b722-7f68-49ec-b9ed-1e1a635037e1-kube-api-access-tdt8l\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.492036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491956    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/01361d98-397b-4f1a-9c59-db9a7768db93-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.492036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491964    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/90154674-3eb6-47f6-8a64-f49c3d53c540-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:30.492036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:30.491972    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2npdd\" (UniqueName: \"kubernetes.io/projected/01361d98-397b-4f1a-9c59-db9a7768db93-kube-api-access-2npdd\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.131967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.131890    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6"
Oct 30 21:21:31.131967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.131902    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d75fdx6" event={"ID":"01361d98-397b-4f1a-9c59-db9a7768db93","Type":"ContainerDied","Data":"fe441a6b843a69f7253ef9e0eb359a57e46c84ac368bf6b70e8bb8e0a5834293"}
Oct 30 21:21:31.131967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.131943    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe441a6b843a69f7253ef9e0eb359a57e46c84ac368bf6b70e8bb8e0a5834293"
Oct 30 21:21:31.133870 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.133851    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f"
Oct 30 21:21:31.133870 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.133866    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6449xn8f" event={"ID":"90154674-3eb6-47f6-8a64-f49c3d53c540","Type":"ContainerDied","Data":"aff87518eaef99134dccfa68e9797d012f57b7257296a705d2e800b0689c092d"}
Oct 30 21:21:31.134057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.133899    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aff87518eaef99134dccfa68e9797d012f57b7257296a705d2e800b0689c092d"
Oct 30 21:21:31.135983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.135959    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth"
Oct 30 21:21:31.136087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.135988    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cfrdth" event={"ID":"81b1b722-7f68-49ec-b9ed-1e1a635037e1","Type":"ContainerDied","Data":"3cbd307ab127b904b157331d784fd349d0342d8d9af143306c4e3c02971908f2"}
Oct 30 21:21:31.136087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.136024    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cbd307ab127b904b157331d784fd349d0342d8d9af143306c4e3c02971908f2"
Oct 30 21:21:31.138289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.138255    4943 generic.go:356] "Generic (PLEG): container finished" podID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerID="fd72298e4ff911ad75459d9dbbc1a6169774868dac2a9e62c698a4af9b1351f3" exitCode=0
Oct 30 21:21:31.138384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.138310    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj" event={"ID":"99a2e52b-e5c4-4aba-a76a-9354d2256340","Type":"ContainerDied","Data":"fd72298e4ff911ad75459d9dbbc1a6169774868dac2a9e62c698a4af9b1351f3"}
Oct 30 21:21:31.301691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.301657    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:21:31.322748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.322721    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:21:31.345368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.345348    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:21:31.350885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.350867    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:21:31.398983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.398956    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-bundle\") pod \"6e5da39c-f244-4460-a6de-b049daa11372\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") "
Oct 30 21:21:31.399148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.398999    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-util\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-util\") pod \"6e5da39c-f244-4460-a6de-b049daa11372\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") "
Oct 30 21:21:31.399148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.399044    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e5da39c-f244-4460-a6de-b049daa11372-kube-api-access-xph6v\" (UniqueName: \"kubernetes.io/projected/6e5da39c-f244-4460-a6de-b049daa11372-kube-api-access-xph6v\") pod \"6e5da39c-f244-4460-a6de-b049daa11372\" (UID: \"6e5da39c-f244-4460-a6de-b049daa11372\") "
Oct 30 21:21:31.399684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.399648    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-bundle" pod "6e5da39c-f244-4460-a6de-b049daa11372" (UID: "6e5da39c-f244-4460-a6de-b049daa11372"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.401146 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.401119    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5da39c-f244-4460-a6de-b049daa11372-kube-api-access-xph6v" pod "6e5da39c-f244-4460-a6de-b049daa11372" (UID: "6e5da39c-f244-4460-a6de-b049daa11372"). InnerVolumeSpecName "kube-api-access-xph6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:31.404810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.404788    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-util" pod "6e5da39c-f244-4460-a6de-b049daa11372" (UID: "6e5da39c-f244-4460-a6de-b049daa11372"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.500175 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500145    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-bundle\") pod \"c1514bd1-41e1-430b-b6ef-0a74e056e551\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") "
Oct 30 21:21:31.500175 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500179    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-util\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-util\") pod \"c1514bd1-41e1-430b-b6ef-0a74e056e551\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") "
Oct 30 21:21:31.500390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500215    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/963a5558-d973-4576-af24-7105fa71bfa3-kube-api-access-xvjbv\" (UniqueName: \"kubernetes.io/projected/963a5558-d973-4576-af24-7105fa71bfa3-kube-api-access-xvjbv\") pod \"963a5558-d973-4576-af24-7105fa71bfa3\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") "
Oct 30 21:21:31.500390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500244    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-bundle\") pod \"98b9268e-605c-4764-ac38-857ee1472b32\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") "
Oct 30 21:21:31.500390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500271    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-util\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-util\") pod \"963a5558-d973-4576-af24-7105fa71bfa3\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") "
Oct 30 21:21:31.500390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500288    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-bundle\") pod \"963a5558-d973-4576-af24-7105fa71bfa3\" (UID: \"963a5558-d973-4576-af24-7105fa71bfa3\") "
Oct 30 21:21:31.500390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500332    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/98b9268e-605c-4764-ac38-857ee1472b32-kube-api-access-wp2x2\" (UniqueName: \"kubernetes.io/projected/98b9268e-605c-4764-ac38-857ee1472b32-kube-api-access-wp2x2\") pod \"98b9268e-605c-4764-ac38-857ee1472b32\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") "
Oct 30 21:21:31.500390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500367    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-util\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-util\") pod \"98b9268e-605c-4764-ac38-857ee1472b32\" (UID: \"98b9268e-605c-4764-ac38-857ee1472b32\") "
Oct 30 21:21:31.500656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500395    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c1514bd1-41e1-430b-b6ef-0a74e056e551-kube-api-access-x4t9j\" (UniqueName: \"kubernetes.io/projected/c1514bd1-41e1-430b-b6ef-0a74e056e551-kube-api-access-x4t9j\") pod \"c1514bd1-41e1-430b-b6ef-0a74e056e551\" (UID: \"c1514bd1-41e1-430b-b6ef-0a74e056e551\") "
Oct 30 21:21:31.500715 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500693    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.500773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500715    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e5da39c-f244-4460-a6de-b049daa11372-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.500773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500730    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xph6v\" (UniqueName: \"kubernetes.io/projected/6e5da39c-f244-4460-a6de-b049daa11372-kube-api-access-xph6v\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.500852 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.500831    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-bundle" pod "98b9268e-605c-4764-ac38-857ee1472b32" (UID: "98b9268e-605c-4764-ac38-857ee1472b32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.501685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.501524    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-bundle" pod "963a5558-d973-4576-af24-7105fa71bfa3" (UID: "963a5558-d973-4576-af24-7105fa71bfa3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.501685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.501605    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-bundle" pod "c1514bd1-41e1-430b-b6ef-0a74e056e551" (UID: "c1514bd1-41e1-430b-b6ef-0a74e056e551"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.502784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.502763    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/963a5558-d973-4576-af24-7105fa71bfa3-kube-api-access-xvjbv" pod "963a5558-d973-4576-af24-7105fa71bfa3" (UID: "963a5558-d973-4576-af24-7105fa71bfa3"). InnerVolumeSpecName "kube-api-access-xvjbv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:31.503215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.503188    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1514bd1-41e1-430b-b6ef-0a74e056e551-kube-api-access-x4t9j" pod "c1514bd1-41e1-430b-b6ef-0a74e056e551" (UID: "c1514bd1-41e1-430b-b6ef-0a74e056e551"). InnerVolumeSpecName "kube-api-access-x4t9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:31.503284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.503264    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98b9268e-605c-4764-ac38-857ee1472b32-kube-api-access-wp2x2" pod "98b9268e-605c-4764-ac38-857ee1472b32" (UID: "98b9268e-605c-4764-ac38-857ee1472b32"). InnerVolumeSpecName "kube-api-access-wp2x2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:31.507253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.507228    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-util" pod "c1514bd1-41e1-430b-b6ef-0a74e056e551" (UID: "c1514bd1-41e1-430b-b6ef-0a74e056e551"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.507338 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.507282    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-util" pod "963a5558-d973-4576-af24-7105fa71bfa3" (UID: "963a5558-d973-4576-af24-7105fa71bfa3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.507572 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.507530    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-util" pod "98b9268e-605c-4764-ac38-857ee1472b32" (UID: "98b9268e-605c-4764-ac38-857ee1472b32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:31.602102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602070    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602095    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/963a5558-d973-4576-af24-7105fa71bfa3-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602105    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wp2x2\" (UniqueName: \"kubernetes.io/projected/98b9268e-605c-4764-ac38-857ee1472b32-kube-api-access-wp2x2\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602114    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602127    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4t9j\" (UniqueName: \"kubernetes.io/projected/c1514bd1-41e1-430b-b6ef-0a74e056e551-kube-api-access-x4t9j\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602136    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602144    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1514bd1-41e1-430b-b6ef-0a74e056e551-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602151    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvjbv\" (UniqueName: \"kubernetes.io/projected/963a5558-d973-4576-af24-7105fa71bfa3-kube-api-access-xvjbv\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:31.602374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:31.602159    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/98b9268e-605c-4764-ac38-857ee1472b32-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:32.145060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.144963    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls" event={"ID":"963a5558-d973-4576-af24-7105fa71bfa3","Type":"ContainerDied","Data":"1808da77c485e1bfd64597b3e4ac4f82665ca096b108ec723856550674432fbb"}
Oct 30 21:21:32.145060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.144988    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651c2n2ls"
Oct 30 21:21:32.145060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.145050    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1808da77c485e1bfd64597b3e4ac4f82665ca096b108ec723856550674432fbb"
Oct 30 21:21:32.147071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.147048    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb"
Oct 30 21:21:32.147224 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.147196    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qsxzb" event={"ID":"c1514bd1-41e1-430b-b6ef-0a74e056e551","Type":"ContainerDied","Data":"c536d557d8fac76f420e2491e74969c2fdc68d6004ccfb997011562b3a165c8a"}
Oct 30 21:21:32.147362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.147242    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c536d557d8fac76f420e2491e74969c2fdc68d6004ccfb997011562b3a165c8a"
Oct 30 21:21:32.149323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.149302    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw" event={"ID":"98b9268e-605c-4764-ac38-857ee1472b32","Type":"ContainerDied","Data":"5c65bf601bad074b9ce2584dd6df1bf22b214c7f8232b8b9aad8180f5df52dda"}
Oct 30 21:21:32.149439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.149341    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c65bf601bad074b9ce2584dd6df1bf22b214c7f8232b8b9aad8180f5df52dda"
Oct 30 21:21:32.149439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.149427    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6j7mzw"
Oct 30 21:21:32.151354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.151299    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6"
Oct 30 21:21:32.151354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.151311    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avgmv6" event={"ID":"6e5da39c-f244-4460-a6de-b049daa11372","Type":"ContainerDied","Data":"11eb1d8c976be4cb4a8e92b7d69aaa093a191955ce4c0342af02fb9490407b26"}
Oct 30 21:21:32.151354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.151354    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11eb1d8c976be4cb4a8e92b7d69aaa093a191955ce4c0342af02fb9490407b26"
Oct 30 21:21:32.275521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.275498    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:21:32.409662 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.409633    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99a2e52b-e5c4-4aba-a76a-9354d2256340-kube-api-access-twcn7\" (UniqueName: \"kubernetes.io/projected/99a2e52b-e5c4-4aba-a76a-9354d2256340-kube-api-access-twcn7\") pod \"99a2e52b-e5c4-4aba-a76a-9354d2256340\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") "
Oct 30 21:21:32.409828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.409695    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-util\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-util\") pod \"99a2e52b-e5c4-4aba-a76a-9354d2256340\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") "
Oct 30 21:21:32.409828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.409734    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-bundle\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-bundle\") pod \"99a2e52b-e5c4-4aba-a76a-9354d2256340\" (UID: \"99a2e52b-e5c4-4aba-a76a-9354d2256340\") "
Oct 30 21:21:32.410156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.410133    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-bundle" pod "99a2e52b-e5c4-4aba-a76a-9354d2256340" (UID: "99a2e52b-e5c4-4aba-a76a-9354d2256340"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:32.411908 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.411884    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a2e52b-e5c4-4aba-a76a-9354d2256340-kube-api-access-twcn7" pod "99a2e52b-e5c4-4aba-a76a-9354d2256340" (UID: "99a2e52b-e5c4-4aba-a76a-9354d2256340"). InnerVolumeSpecName "kube-api-access-twcn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:21:32.415121 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.415100    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-util" pod "99a2e52b-e5c4-4aba-a76a-9354d2256340" (UID: "99a2e52b-e5c4-4aba-a76a-9354d2256340"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:21:32.510624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.510595    4943 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-bundle\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:32.510624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.510625    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twcn7\" (UniqueName: \"kubernetes.io/projected/99a2e52b-e5c4-4aba-a76a-9354d2256340-kube-api-access-twcn7\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:32.510799 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:32.510639    4943 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99a2e52b-e5c4-4aba-a76a-9354d2256340-util\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:21:33.158618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:33.158592    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj"
Oct 30 21:21:33.159072 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:33.158593    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444z9pj" event={"ID":"99a2e52b-e5c4-4aba-a76a-9354d2256340","Type":"ContainerDied","Data":"46a66173da17a0f6c00854affa2d3795eb8f0afac89cd8609a6bcc867bca67a5"}
Oct 30 21:21:33.159072 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:33.158709    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46a66173da17a0f6c00854affa2d3795eb8f0afac89cd8609a6bcc867bca67a5"
Oct 30 21:21:33.480031 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:33.479947    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:33.753448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:33.753369    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:34.101455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.101373    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:34.254189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254158    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"]
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254497    4943 cpu_manager.go:414] "containerMap: removing container" podUID="963a5558-d973-4576-af24-7105fa71bfa3" containerName="pull"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254509    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="963a5558-d973-4576-af24-7105fa71bfa3" containerName="pull"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254518    4943 cpu_manager.go:414] "containerMap: removing container" podUID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerName="extract"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254523    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerName="extract"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254536    4943 cpu_manager.go:414] "containerMap: removing container" podUID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerName="pull"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254541    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerName="pull"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254549    4943 cpu_manager.go:414] "containerMap: removing container" podUID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerName="util"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254566    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerName="util"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254572    4943 cpu_manager.go:414] "containerMap: removing container" podUID="01361d98-397b-4f1a-9c59-db9a7768db93" containerName="pull"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254577    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01361d98-397b-4f1a-9c59-db9a7768db93" containerName="pull"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254583    4943 cpu_manager.go:414] "containerMap: removing container" podUID="963a5558-d973-4576-af24-7105fa71bfa3" containerName="extract"
Oct 30 21:21:34.254586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254588    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="963a5558-d973-4576-af24-7105fa71bfa3" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254595    4943 cpu_manager.go:414] "containerMap: removing container" podUID="98b9268e-605c-4764-ac38-857ee1472b32" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254631    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98b9268e-605c-4764-ac38-857ee1472b32" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254637    4943 cpu_manager.go:414] "containerMap: removing container" podUID="b9177c47-2a77-4047-8b35-3c414b824616" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254641    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9177c47-2a77-4047-8b35-3c414b824616" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254647    4943 cpu_manager.go:414] "containerMap: removing container" podUID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254651    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254657    4943 cpu_manager.go:414] "containerMap: removing container" podUID="6e5da39c-f244-4460-a6de-b049daa11372" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254661    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e5da39c-f244-4460-a6de-b049daa11372" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254670    4943 cpu_manager.go:414] "containerMap: removing container" podUID="b9177c47-2a77-4047-8b35-3c414b824616" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254675    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9177c47-2a77-4047-8b35-3c414b824616" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254680    4943 cpu_manager.go:414] "containerMap: removing container" podUID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254685    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254690    4943 cpu_manager.go:414] "containerMap: removing container" podUID="963a5558-d973-4576-af24-7105fa71bfa3" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254695    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="963a5558-d973-4576-af24-7105fa71bfa3" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254701    4943 cpu_manager.go:414] "containerMap: removing container" podUID="01361d98-397b-4f1a-9c59-db9a7768db93" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254706    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01361d98-397b-4f1a-9c59-db9a7768db93" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254711    4943 cpu_manager.go:414] "containerMap: removing container" podUID="6e5da39c-f244-4460-a6de-b049daa11372" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254716    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e5da39c-f244-4460-a6de-b049daa11372" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254722    4943 cpu_manager.go:414] "containerMap: removing container" podUID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254726    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254735    4943 cpu_manager.go:414] "containerMap: removing container" podUID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254740    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254747    4943 cpu_manager.go:414] "containerMap: removing container" podUID="98b9268e-605c-4764-ac38-857ee1472b32" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254751    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98b9268e-605c-4764-ac38-857ee1472b32" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254756    4943 cpu_manager.go:414] "containerMap: removing container" podUID="b9177c47-2a77-4047-8b35-3c414b824616" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254760    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9177c47-2a77-4047-8b35-3c414b824616" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254766    4943 cpu_manager.go:414] "containerMap: removing container" podUID="01361d98-397b-4f1a-9c59-db9a7768db93" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254771    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01361d98-397b-4f1a-9c59-db9a7768db93" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254776    4943 cpu_manager.go:414] "containerMap: removing container" podUID="98b9268e-605c-4764-ac38-857ee1472b32" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254780    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="98b9268e-605c-4764-ac38-857ee1472b32" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254788    4943 cpu_manager.go:414] "containerMap: removing container" podUID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254793    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254804    4943 cpu_manager.go:414] "containerMap: removing container" podUID="6e5da39c-f244-4460-a6de-b049daa11372" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254808    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e5da39c-f244-4460-a6de-b049daa11372" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254814    4943 cpu_manager.go:414] "containerMap: removing container" podUID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254819    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254825    4943 cpu_manager.go:414] "containerMap: removing container" podUID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254829    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerName="pull"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254835    4943 cpu_manager.go:414] "containerMap: removing container" podUID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254839    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254848    4943 cpu_manager.go:414] "containerMap: removing container" podUID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254852    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerName="util"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254902    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="c1514bd1-41e1-430b-b6ef-0a74e056e551" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254911    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="963a5558-d973-4576-af24-7105fa71bfa3" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254917    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="81b1b722-7f68-49ec-b9ed-1e1a635037e1" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254923    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e5da39c-f244-4460-a6de-b049daa11372" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254929    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="01361d98-397b-4f1a-9c59-db9a7768db93" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254934    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9177c47-2a77-4047-8b35-3c414b824616" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254939    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="98b9268e-605c-4764-ac38-857ee1472b32" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254946    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="90154674-3eb6-47f6-8a64-f49c3d53c540" containerName="extract"
Oct 30 21:21:34.254957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.254952    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="99a2e52b-e5c4-4aba-a76a-9354d2256340" containerName="extract"
Oct 30 21:21:34.256952 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.256938    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.314871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.314842    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 30 21:21:34.314871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.314857    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 30 21:21:34.315065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.314927    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 30 21:21:34.361679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.361611    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 30 21:21:34.361679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.361641    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-929kb\""
Oct 30 21:21:34.361679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.361643    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 30 21:21:34.427494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.427453    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.427494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.427496    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d7c22f6-962c-4de5-882d-19a6fbba950a-tmp\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.427769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.427525    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-metrics-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.427769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.427668    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d7c22f6-962c-4de5-882d-19a6fbba950a-manifests\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.427769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.427734    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.427769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.427762    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5nbv\" (UniqueName: \"kubernetes.io/projected/6d7c22f6-962c-4de5-882d-19a6fbba950a-kube-api-access-m5nbv\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.458869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.458834    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:34.492008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.491983    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"]
Oct 30 21:21:34.528838 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.528809    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.528968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.528839    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5nbv\" (UniqueName: \"kubernetes.io/projected/6d7c22f6-962c-4de5-882d-19a6fbba950a-kube-api-access-m5nbv\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.528968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.528877    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.528968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.528894    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d7c22f6-962c-4de5-882d-19a6fbba950a-tmp\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.528968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.528923    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-metrics-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.528968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.528955    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d7c22f6-962c-4de5-882d-19a6fbba950a-manifests\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.529443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.529417    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6d7c22f6-962c-4de5-882d-19a6fbba950a-manifests\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.531493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.531469    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.531698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.531682    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-metrics-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.531751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.531692    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6d7c22f6-962c-4de5-882d-19a6fbba950a-tmp\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.531810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.531793    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d7c22f6-962c-4de5-882d-19a6fbba950a-webhook-cert\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.589418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.589392    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5nbv\" (UniqueName: \"kubernetes.io/projected/6d7c22f6-962c-4de5-882d-19a6fbba950a-kube-api-access-m5nbv\") pod \"opendatahub-operator-controller-manager-85bb549b7d-9nxnh\" (UID: \"6d7c22f6-962c-4de5-882d-19a6fbba950a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.646977 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.646913    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:34.869473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.869440    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:34.911448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:34.911412    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:35.097646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:35.097614    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:35.424245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:35.424221    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"]
Oct 30 21:21:35.426537 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:21:35.426509    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7c22f6_962c_4de5_882d_19a6fbba950a.slice/crio-c03619a0d3814e325737a7c4d0b21e35899709a7c237c8878998d4dda488d1cf WatchSource:0}: Error finding container c03619a0d3814e325737a7c4d0b21e35899709a7c237c8878998d4dda488d1cf: Status 404 returned error can't find the container with id c03619a0d3814e325737a7c4d0b21e35899709a7c237c8878998d4dda488d1cf
Oct 30 21:21:36.173364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:36.173331    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh" event={"ID":"6d7c22f6-962c-4de5-882d-19a6fbba950a","Type":"ContainerStarted","Data":"c03619a0d3814e325737a7c4d0b21e35899709a7c237c8878998d4dda488d1cf"}
Oct 30 21:21:37.538963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:37.538932    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:37.734334 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:37.734298    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:38.064040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:38.064002    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:39.189489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:39.189455    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh" event={"ID":"6d7c22f6-962c-4de5-882d-19a6fbba950a","Type":"ContainerStarted","Data":"d1285aff755298aa2d313d599ae5f0638651e72780377bd709f9dfe4b6da3109"}
Oct 30 21:21:40.196475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:40.196442    4943 generic.go:356] "Generic (PLEG): container finished" podID="6d7c22f6-962c-4de5-882d-19a6fbba950a" containerID="d1285aff755298aa2d313d599ae5f0638651e72780377bd709f9dfe4b6da3109" exitCode=0
Oct 30 21:21:40.196886 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:40.196520    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh" event={"ID":"6d7c22f6-962c-4de5-882d-19a6fbba950a","Type":"ContainerDied","Data":"d1285aff755298aa2d313d599ae5f0638651e72780377bd709f9dfe4b6da3109"}
Oct 30 21:21:41.203698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.203664    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh" event={"ID":"6d7c22f6-962c-4de5-882d-19a6fbba950a","Type":"ContainerStarted","Data":"a4abaa720e8ef8bd97059fcc86e72c7c0c61f45ca44aa8570a0b1bca0ae30bbf"}
Oct 30 21:21:41.204067 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.203911    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:41.439350 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.439301    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh" podStartSLOduration=2.666390405 podStartE2EDuration="7.439284165s" totalImagesPullingTime="4.33496291s" totalInitContainerRuntime="437.93085ms" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:41.389677172 +0000 UTC m=+295.885250525" watchObservedRunningTime="2026-10-30 21:21:41.439284165 +0000 UTC m=+295.934857516"
Oct 30 21:21:41.756122 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.756039    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"]
Oct 30 21:21:41.758208 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.758187    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:41.818866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.818839    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 30 21:21:41.818866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.818855    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:21:41.818988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.818917    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-xcs8s\""
Oct 30 21:21:41.844995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.844971    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"]
Oct 30 21:21:41.890421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.890394    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a56ae1b-2fbf-4c36-bdb6-ded25a09a449-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt\" (UID: \"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:41.890540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.890459    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvcdr\" (UniqueName: \"kubernetes.io/projected/5a56ae1b-2fbf-4c36-bdb6-ded25a09a449-kube-api-access-kvcdr\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt\" (UID: \"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:41.991080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.991059    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcdr\" (UniqueName: \"kubernetes.io/projected/5a56ae1b-2fbf-4c36-bdb6-ded25a09a449-kube-api-access-kvcdr\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt\" (UID: \"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:41.991195 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.991104    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a56ae1b-2fbf-4c36-bdb6-ded25a09a449-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt\" (UID: \"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:41.991488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:41.991471    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5a56ae1b-2fbf-4c36-bdb6-ded25a09a449-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt\" (UID: \"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:42.047995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:42.047935    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvcdr\" (UniqueName: \"kubernetes.io/projected/5a56ae1b-2fbf-4c36-bdb6-ded25a09a449-kube-api-access-kvcdr\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt\" (UID: \"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:42.068512 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:42.068493    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"
Oct 30 21:21:42.495228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:42.495196    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt"]
Oct 30 21:21:42.498948 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:21:42.498922    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a56ae1b_2fbf_4c36_bdb6_ded25a09a449.slice/crio-5bfdf6faa1f3f6a740ca3a0c29dbfd34bc413284dd6d363f0f0722b96861d28c WatchSource:0}: Error finding container 5bfdf6faa1f3f6a740ca3a0c29dbfd34bc413284dd6d363f0f0722b96861d28c: Status 404 returned error can't find the container with id 5bfdf6faa1f3f6a740ca3a0c29dbfd34bc413284dd6d363f0f0722b96861d28c
Oct 30 21:21:43.097942 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:43.097911    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:43.214230 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:43.214195    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt" event={"ID":"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449","Type":"ContainerStarted","Data":"5bfdf6faa1f3f6a740ca3a0c29dbfd34bc413284dd6d363f0f0722b96861d28c"}
Oct 30 21:21:43.317343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:43.317311    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:43.559002 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:43.558965    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:45.245989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.245952    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:45.594158 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.594087    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"]
Oct 30 21:21:45.598906 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.598890    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:45.617161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.617116    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k82hv\" (UniqueName: \"kubernetes.io/projected/fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb-kube-api-access-k82hv\") pod \"jobset-operator-674cd59dc5-h6vvq\" (UID: \"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:45.617308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.617173    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb-tmp\") pod \"jobset-operator-674cd59dc5-h6vvq\" (UID: \"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:45.634566 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.634519    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:21:45.635572 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.635538    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:21:45.700657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.700615    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 30 21:21:45.700657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.700630    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-zfln9\""
Oct 30 21:21:45.700882 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.700771    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 30 21:21:45.702482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.702461    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"]
Oct 30 21:21:45.718071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.718037    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k82hv\" (UniqueName: \"kubernetes.io/projected/fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb-kube-api-access-k82hv\") pod \"jobset-operator-674cd59dc5-h6vvq\" (UID: \"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:45.718172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.718076    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb-tmp\") pod \"jobset-operator-674cd59dc5-h6vvq\" (UID: \"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:45.718443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.718426    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb-tmp\") pod \"jobset-operator-674cd59dc5-h6vvq\" (UID: \"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:45.782808 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.782781    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k82hv\" (UniqueName: \"kubernetes.io/projected/fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb-kube-api-access-k82hv\") pod \"jobset-operator-674cd59dc5-h6vvq\" (UID: \"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:45.918906 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:45.918875    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"
Oct 30 21:21:46.286260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:46.286179    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq"]
Oct 30 21:21:46.289105 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:21:46.289074    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd12e4da_f4e3_41ba_9e61_48d3ba6c0acb.slice/crio-47f1f516cd3b9a93781374ea31da62dad285426fbaa256eb22df984b5981915f WatchSource:0}: Error finding container 47f1f516cd3b9a93781374ea31da62dad285426fbaa256eb22df984b5981915f: Status 404 returned error can't find the container with id 47f1f516cd3b9a93781374ea31da62dad285426fbaa256eb22df984b5981915f
Oct 30 21:21:46.469356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:46.469325    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:46.655048 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:46.655013    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:47.234372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:47.234338    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq" event={"ID":"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb","Type":"ContainerStarted","Data":"47f1f516cd3b9a93781374ea31da62dad285426fbaa256eb22df984b5981915f"}
Oct 30 21:21:50.250496 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:50.250465    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq" event={"ID":"fd12e4da-f4e3-41ba-9e61-48d3ba6c0acb","Type":"ContainerStarted","Data":"d26b73788ff4ef68aa5ef918613d8ede983b2d24e1efbc68233794afabf20a85"}
Oct 30 21:21:50.365011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:50.364956    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-h6vvq" podStartSLOduration=2.052519499 podStartE2EDuration="5.364942379s" totalImagesPullingTime="3.31242288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:50.363348426 +0000 UTC m=+304.858921780" watchObservedRunningTime="2026-10-30 21:21:50.364942379 +0000 UTC m=+304.860515729"
Oct 30 21:21:51.067525 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:21:51.067486    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:21:52.126099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:52.126063    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:52.210705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:52.210680    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-85bb549b7d-9nxnh"
Oct 30 21:21:52.262580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:52.262535    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt" event={"ID":"5a56ae1b-2fbf-4c36-bdb6-ded25a09a449","Type":"ContainerStarted","Data":"4a68cb42852f9ed465c99bb461dafff2f0770c149cecbdfd820383e459b1371f"}
Oct 30 21:21:52.568384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:52.568320    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-5fdnt" podStartSLOduration=2.619720843 podStartE2EDuration="11.56830217s" totalImagesPullingTime="8.948581327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:21:52.567650023 +0000 UTC m=+307.063223386" watchObservedRunningTime="2026-10-30 21:21:52.56830217 +0000 UTC m=+307.063875522"
Oct 30 21:21:53.101442 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:53.101406    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:53.355807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:53.355724    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:55.395974 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.395945    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:55.643148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.643114    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"]
Oct 30 21:21:55.645237 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.645221    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"
Oct 30 21:21:55.695075 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.695036    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lsqg\" (UniqueName: \"kubernetes.io/projected/98a6dbff-dd7d-4aa3-8813-99df235c43e0-kube-api-access-5lsqg\") pod \"dns-operator-controller-manager-8557cbdb84-mvxnn\" (UID: \"98a6dbff-dd7d-4aa3-8813-99df235c43e0\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"
Oct 30 21:21:55.699212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.699162    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 30 21:21:55.699350 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.699267    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 30 21:21:55.737287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.737265    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 30 21:21:55.747937 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.747916    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xdwhb\""
Oct 30 21:21:55.750158 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.750132    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"]
Oct 30 21:21:55.796184 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.796160    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lsqg\" (UniqueName: \"kubernetes.io/projected/98a6dbff-dd7d-4aa3-8813-99df235c43e0-kube-api-access-5lsqg\") pod \"dns-operator-controller-manager-8557cbdb84-mvxnn\" (UID: \"98a6dbff-dd7d-4aa3-8813-99df235c43e0\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"
Oct 30 21:21:55.805129 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.805091    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:55.858090 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.858057    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lsqg\" (UniqueName: \"kubernetes.io/projected/98a6dbff-dd7d-4aa3-8813-99df235c43e0-kube-api-access-5lsqg\") pod \"dns-operator-controller-manager-8557cbdb84-mvxnn\" (UID: \"98a6dbff-dd7d-4aa3-8813-99df235c43e0\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"
Oct 30 21:21:55.956724 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:55.956650    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"
Oct 30 21:21:56.086860 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:56.086825    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:56.418654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:56.418627    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"]
Oct 30 21:21:56.422145 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:21:56.422118    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98a6dbff_dd7d_4aa3_8813_99df235c43e0.slice/crio-46a2cb93764a58d68dea675ce535cc1a93cc39dd825bd3ca8455abee4d01706c WatchSource:0}: Error finding container 46a2cb93764a58d68dea675ce535cc1a93cc39dd825bd3ca8455abee4d01706c: Status 404 returned error can't find the container with id 46a2cb93764a58d68dea675ce535cc1a93cc39dd825bd3ca8455abee4d01706c
Oct 30 21:21:56.424274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:56.424257    4943 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:21:56.883583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:56.883464    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:57.287684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:57.287643    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn" event={"ID":"98a6dbff-dd7d-4aa3-8813-99df235c43e0","Type":"ContainerStarted","Data":"46a2cb93764a58d68dea675ce535cc1a93cc39dd825bd3ca8455abee4d01706c"}
Oct 30 21:21:57.528545 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:57.528510    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:57.721055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:57.721023    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:21:59.368361 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.368329    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"]
Oct 30 21:21:59.374578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.374544    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"
Oct 30 21:21:59.424501 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.424466    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njrbf\" (UniqueName: \"kubernetes.io/projected/68d9c8f8-4f03-4869-a585-a809aa938336-kube-api-access-njrbf\") pod \"authorino-operator-7b7bb4bc77-h8k2b\" (UID: \"68d9c8f8-4f03-4869-a585-a809aa938336\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"
Oct 30 21:21:59.477172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.477145    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-v2wbz\""
Oct 30 21:21:59.487619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.487591    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"]
Oct 30 21:21:59.525598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.525574    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njrbf\" (UniqueName: \"kubernetes.io/projected/68d9c8f8-4f03-4869-a585-a809aa938336-kube-api-access-njrbf\") pod \"authorino-operator-7b7bb4bc77-h8k2b\" (UID: \"68d9c8f8-4f03-4869-a585-a809aa938336\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"
Oct 30 21:21:59.582802 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.582773    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njrbf\" (UniqueName: \"kubernetes.io/projected/68d9c8f8-4f03-4869-a585-a809aa938336-kube-api-access-njrbf\") pod \"authorino-operator-7b7bb4bc77-h8k2b\" (UID: \"68d9c8f8-4f03-4869-a585-a809aa938336\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"
Oct 30 21:21:59.690051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.690005    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"
Oct 30 21:21:59.738002 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:21:59.737938    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:00.058716 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.058679    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:00.072849 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.072787    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"]
Oct 30 21:22:00.075645 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:22:00.075613    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68d9c8f8_4f03_4869_a585_a809aa938336.slice/crio-cfa94985384f84acb3d75a0678331b4bab0247a8bd4ee46eaf40ede4ec6971b7 WatchSource:0}: Error finding container cfa94985384f84acb3d75a0678331b4bab0247a8bd4ee46eaf40ede4ec6971b7: Status 404 returned error can't find the container with id cfa94985384f84acb3d75a0678331b4bab0247a8bd4ee46eaf40ede4ec6971b7
Oct 30 21:22:00.248845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.248777    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:00.306222 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.306181    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn" event={"ID":"98a6dbff-dd7d-4aa3-8813-99df235c43e0","Type":"ContainerStarted","Data":"dea17e4364b9873eb139cce6eec27760e3d174f5f4a5e1cf21833a9eca323c49"}
Oct 30 21:22:00.306393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.306376    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"
Oct 30 21:22:00.307726 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.307703    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b" event={"ID":"68d9c8f8-4f03-4869-a585-a809aa938336","Type":"ContainerStarted","Data":"cfa94985384f84acb3d75a0678331b4bab0247a8bd4ee46eaf40ede4ec6971b7"}
Oct 30 21:22:00.425856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.425797    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn" podStartSLOduration=1.919273514 podStartE2EDuration="5.425783213s" totalImagesPullingTime="3.506509699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:00.42322033 +0000 UTC m=+314.918793683" watchObservedRunningTime="2026-10-30 21:22:00.425783213 +0000 UTC m=+314.921356564"
Oct 30 21:22:00.885678 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:00.885646    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:01.476694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:01.476660    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:01.769239 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:01.769168    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:02.957146 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:02.957111    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:03.188877 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:03.188845    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:03.502054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:03.502014    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:04.112126 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:04.112098    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:04.342488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:04.342459    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:05.717415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.717381    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"]
Oct 30 21:22:05.720852 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.720833    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:05.774226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.774194    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"]
Oct 30 21:22:05.782616 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.782589    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldg62\" (UniqueName: \"kubernetes.io/projected/0472298e-497f-4cfc-8226-cef5d5341ec2-kube-api-access-ldg62\") pod \"kuadrant-operator-controller-manager-678d87766f-lrvx2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:05.782739 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.782716    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472298e-497f-4cfc-8226-cef5d5341ec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-lrvx2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:05.821457 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.821434    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cxzr5\""
Oct 30 21:22:05.883509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.883467    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldg62\" (UniqueName: \"kubernetes.io/projected/0472298e-497f-4cfc-8226-cef5d5341ec2-kube-api-access-ldg62\") pod \"kuadrant-operator-controller-manager-678d87766f-lrvx2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:05.883705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.883551    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472298e-497f-4cfc-8226-cef5d5341ec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-lrvx2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:05.883995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.883945    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472298e-497f-4cfc-8226-cef5d5341ec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-lrvx2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:05.941022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:05.940994    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldg62\" (UniqueName: \"kubernetes.io/projected/0472298e-497f-4cfc-8226-cef5d5341ec2-kube-api-access-ldg62\") pod \"kuadrant-operator-controller-manager-678d87766f-lrvx2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:06.032796 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:06.032731    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:06.342456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:06.342379    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b" event={"ID":"68d9c8f8-4f03-4869-a585-a809aa938336","Type":"ContainerStarted","Data":"c671b32dbab6fe297f819fe1a7c5b4fa4a8200ed8a608678a20da7b9745985cd"}
Oct 30 21:22:06.342678 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:06.342538    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"
Oct 30 21:22:06.459231 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:06.459182    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b" podStartSLOduration=2.15204134 podStartE2EDuration="7.459169674s" totalImagesPullingTime="5.307128334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:21:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:06.457147571 +0000 UTC m=+320.952720921" watchObservedRunningTime="2026-10-30 21:22:06.459169674 +0000 UTC m=+320.954743025"
Oct 30 21:22:06.512489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:06.512464    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"]
Oct 30 21:22:06.515130 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:22:06.515104    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0472298e_497f_4cfc_8226_cef5d5341ec2.slice/crio-7ea882390decb34218014f10632bde76ca32b9be7fd961886e6a47da1ac5d76b WatchSource:0}: Error finding container 7ea882390decb34218014f10632bde76ca32b9be7fd961886e6a47da1ac5d76b: Status 404 returned error can't find the container with id 7ea882390decb34218014f10632bde76ca32b9be7fd961886e6a47da1ac5d76b
Oct 30 21:22:06.653139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:06.653107    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:07.301996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:07.301965    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:07.348569 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:07.348517    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2" event={"ID":"0472298e-497f-4cfc-8226-cef5d5341ec2","Type":"ContainerStarted","Data":"7ea882390decb34218014f10632bde76ca32b9be7fd961886e6a47da1ac5d76b"}
Oct 30 21:22:08.258786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.258751    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"]
Oct 30 21:22:08.262843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.262821    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"
Oct 30 21:22:08.302791 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.302763    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdns4\" (UniqueName: \"kubernetes.io/projected/c9d7a056-f88a-470c-9b0a-6acc8acce466-kube-api-access-vdns4\") pod \"limitador-operator-controller-manager-5778bb4449-42fbr\" (UID: \"c9d7a056-f88a-470c-9b0a-6acc8acce466\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"
Oct 30 21:22:08.366494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.366458    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4c4cp\""
Oct 30 21:22:08.368328 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.368306    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"]
Oct 30 21:22:08.403466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.403432    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdns4\" (UniqueName: \"kubernetes.io/projected/c9d7a056-f88a-470c-9b0a-6acc8acce466-kube-api-access-vdns4\") pod \"limitador-operator-controller-manager-5778bb4449-42fbr\" (UID: \"c9d7a056-f88a-470c-9b0a-6acc8acce466\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"
Oct 30 21:22:08.465495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.465466    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdns4\" (UniqueName: \"kubernetes.io/projected/c9d7a056-f88a-470c-9b0a-6acc8acce466-kube-api-access-vdns4\") pod \"limitador-operator-controller-manager-5778bb4449-42fbr\" (UID: \"c9d7a056-f88a-470c-9b0a-6acc8acce466\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"
Oct 30 21:22:08.578503 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.578434    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"
Oct 30 21:22:08.970512 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:08.970474    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"]
Oct 30 21:22:09.003542 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:22:09.003516    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d7a056_f88a_470c_9b0a_6acc8acce466.slice/crio-5c2e58b9f370e1c10652d8fe6b8ceed638009f9e3c2dc525802fbb9805efac34 WatchSource:0}: Error finding container 5c2e58b9f370e1c10652d8fe6b8ceed638009f9e3c2dc525802fbb9805efac34: Status 404 returned error can't find the container with id 5c2e58b9f370e1c10652d8fe6b8ceed638009f9e3c2dc525802fbb9805efac34
Oct 30 21:22:09.360798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:09.360722    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr" event={"ID":"c9d7a056-f88a-470c-9b0a-6acc8acce466","Type":"ContainerStarted","Data":"5c2e58b9f370e1c10652d8fe6b8ceed638009f9e3c2dc525802fbb9805efac34"}
Oct 30 21:22:09.660703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:09.660672    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:09.845989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:09.845950    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:11.315172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:11.315144    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-mvxnn"
Oct 30 21:22:12.378342 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:12.378298    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr" event={"ID":"c9d7a056-f88a-470c-9b0a-6acc8acce466","Type":"ContainerStarted","Data":"1a2b5d08346583e1ddc044fa23b8c034ae0874862c8e0bd5af3a1227399e377e"}
Oct 30 21:22:12.378738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:12.378380    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"
Oct 30 21:22:12.496214 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:12.496149    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr" podStartSLOduration=1.891833324 podStartE2EDuration="4.496129861s" totalImagesPullingTime="2.604296537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:12.493177666 +0000 UTC m=+326.988751018" watchObservedRunningTime="2026-10-30 21:22:12.496129861 +0000 UTC m=+326.991703213"
Oct 30 21:22:13.384595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:13.384537    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2" event={"ID":"0472298e-497f-4cfc-8226-cef5d5341ec2","Type":"ContainerStarted","Data":"3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53"}
Oct 30 21:22:13.385078 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:13.384859    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:13.602683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:13.602627    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2" podStartSLOduration=2.484844751 podStartE2EDuration="8.602609642s" totalImagesPullingTime="6.117764891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:13.556843862 +0000 UTC m=+328.052417214" watchObservedRunningTime="2026-10-30 21:22:13.602609642 +0000 UTC m=+328.098182992"
Oct 30 21:22:15.281892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:15.281842    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:15.471502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:15.471464    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:15.658976 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:15.658940    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:16.984204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:16.984157    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:17.177070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:17.177038    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:17.351404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:17.351333    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-h8k2b"
Oct 30 21:22:19.056610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:19.056576    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:19.246385 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:19.246357    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:21.062360 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:22:21.062326    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:22:23.386749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:23.386721    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-42fbr"
Oct 30 21:22:24.394601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:24.394568    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 21:22:26.105476 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:26.105438    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:26.279148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:26.279116    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:28.675995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:28.675965    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:28.857604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:28.857572    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:34.075187 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:34.075138    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:34.246061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:34.246025    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:34.466846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:34.466797    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:34.699113 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:34.699073    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:37.934499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:37.934457    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:38.696106 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:38.696064    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:38.879314 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:38.879279    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:40.611490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:40.611455    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:40.804437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:40.804404    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:41.101446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:41.101411    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:42.669385 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:42.669351    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:42.884841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:42.884807    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:43.111061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.110989    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"]
Oct 30 21:22:43.112330 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.112306    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:43.164182 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.164146    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.178247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.178217    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"]
Oct 30 21:22:43.223939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.223917    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pt4wk\""
Oct 30 21:22:43.298749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.298715    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.298749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.298749    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.298961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.298772    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.298961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.298828    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpcfp\" (UniqueName: \"kubernetes.io/projected/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-kube-api-access-hpcfp\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.299042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.298968    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.299078 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.299040    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.299078 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.299064    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.299147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.299111    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.299147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.299132    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.311346 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.311315    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:43.399665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.399623    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.399977    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400021    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400048    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpcfp\" (UniqueName: \"kubernetes.io/projected/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-kube-api-access-hpcfp\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400203 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400173    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400306 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400281    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400328    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400367    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400394    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400475    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400749    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400790    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.400884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400823    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.401007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.400968    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.403015 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.402988    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.403225 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.403210    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.457144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.457121    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpcfp\" (UniqueName: \"kubernetes.io/projected/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-kube-api-access-hpcfp\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.460672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.460655    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff8eb018-788a-4b5c-a68c-2606ac78b5f3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z\" (UID: \"ff8eb018-788a-4b5c-a68c-2606ac78b5f3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.491979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.491955    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:43.493947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.493917    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:43.685441 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.685353    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:43.937582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.937478    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"]
Oct 30 21:22:43.940466 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:22:43.940443    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8eb018_788a_4b5c_a68c_2606ac78b5f3.slice/crio-74181e4aa859078435b6625aee86c7b0119d12e9099a596640aa0bfd5867b3bb WatchSource:0}: Error finding container 74181e4aa859078435b6625aee86c7b0119d12e9099a596640aa0bfd5867b3bb: Status 404 returned error can't find the container with id 74181e4aa859078435b6625aee86c7b0119d12e9099a596640aa0bfd5867b3bb
Oct 30 21:22:43.942537 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.942503    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:22:43.942664 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.942597    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:22:43.942664 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:43.942651    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:22:44.539861 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:44.539825    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z" event={"ID":"ff8eb018-788a-4b5c-a68c-2606ac78b5f3","Type":"ContainerStarted","Data":"f32cff88c43e26c16658a9846dc3cc0f7d6e4199c2876ca3b40605e45ce4d57a"}
Oct 30 21:22:44.540029 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:44.539880    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z" event={"ID":"ff8eb018-788a-4b5c-a68c-2606ac78b5f3","Type":"ContainerStarted","Data":"74181e4aa859078435b6625aee86c7b0119d12e9099a596640aa0bfd5867b3bb"}
Oct 30 21:22:44.764311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:44.764258    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z" podStartSLOduration=1.764243547 podStartE2EDuration="1.764243547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:44.713090895 +0000 UTC m=+359.208664260" watchObservedRunningTime="2026-10-30 21:22:44.764243547 +0000 UTC m=+359.259816902"
Oct 30 21:22:45.160926 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.160858    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:45.495014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.494933    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:45.499350 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.499328    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:45.503708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.503682    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:45.545210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.545181    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:45.546030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.546015    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z"
Oct 30 21:22:45.688882 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.688848    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:45.897976 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:45.897945    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.660927 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.660896    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-g6j5c"]
Oct 30 21:22:46.663482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.663465    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-g6j5c"
Oct 30 21:22:46.715981 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.715954    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7nzgf\""
Oct 30 21:22:46.724303 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.720002    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-g6j5c"]
Oct 30 21:22:46.726473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.726451    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b5bw\" (UniqueName: \"kubernetes.io/projected/b36f7317-db7d-4a79-98e1-a315cb64eea4-kube-api-access-8b5bw\") pod \"authorino-57f7f8659f-g6j5c\" (UID: \"b36f7317-db7d-4a79-98e1-a315cb64eea4\") " pod="kuadrant-system/authorino-57f7f8659f-g6j5c"
Oct 30 21:22:46.827068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.827034    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b5bw\" (UniqueName: \"kubernetes.io/projected/b36f7317-db7d-4a79-98e1-a315cb64eea4-kube-api-access-8b5bw\") pod \"authorino-57f7f8659f-g6j5c\" (UID: \"b36f7317-db7d-4a79-98e1-a315cb64eea4\") " pod="kuadrant-system/authorino-57f7f8659f-g6j5c"
Oct 30 21:22:46.887634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.887606    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b5bw\" (UniqueName: \"kubernetes.io/projected/b36f7317-db7d-4a79-98e1-a315cb64eea4-kube-api-access-8b5bw\") pod \"authorino-57f7f8659f-g6j5c\" (UID: \"b36f7317-db7d-4a79-98e1-a315cb64eea4\") " pod="kuadrant-system/authorino-57f7f8659f-g6j5c"
Oct 30 21:22:46.949188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.949094    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:46.974003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:46.973979    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-g6j5c"
Oct 30 21:22:47.130379 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:47.130342    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:47.342191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:47.342124    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-g6j5c"]
Oct 30 21:22:47.344880 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:22:47.344852    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb36f7317_db7d_4a79_98e1_a315cb64eea4.slice/crio-a29ec6e83e9dff87ba12e7e5bce9b3acf047a5e4de44921572c44d4525fd4762 WatchSource:0}: Error finding container a29ec6e83e9dff87ba12e7e5bce9b3acf047a5e4de44921572c44d4525fd4762: Status 404 returned error can't find the container with id a29ec6e83e9dff87ba12e7e5bce9b3acf047a5e4de44921572c44d4525fd4762
Oct 30 21:22:47.555628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:47.555595    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-g6j5c" event={"ID":"b36f7317-db7d-4a79-98e1-a315cb64eea4","Type":"ContainerStarted","Data":"a29ec6e83e9dff87ba12e7e5bce9b3acf047a5e4de44921572c44d4525fd4762"}
Oct 30 21:22:49.468058 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:49.468023    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2phtb"]
Oct 30 21:22:49.470888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:49.470866    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb"
Oct 30 21:22:49.526498 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:49.526471    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2phtb"]
Oct 30 21:22:49.543163 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:49.543135    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdx5g\" (UniqueName: \"kubernetes.io/projected/43317211-20bd-4601-a018-0a40871dd9c4-kube-api-access-xdx5g\") pod \"authorino-56c6c9ddd5-2phtb\" (UID: \"43317211-20bd-4601-a018-0a40871dd9c4\") " pod="kuadrant-system/authorino-56c6c9ddd5-2phtb"
Oct 30 21:22:49.643539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:49.643506    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdx5g\" (UniqueName: \"kubernetes.io/projected/43317211-20bd-4601-a018-0a40871dd9c4-kube-api-access-xdx5g\") pod \"authorino-56c6c9ddd5-2phtb\" (UID: \"43317211-20bd-4601-a018-0a40871dd9c4\") " pod="kuadrant-system/authorino-56c6c9ddd5-2phtb"
Oct 30 21:22:49.702125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:49.702097    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdx5g\" (UniqueName: \"kubernetes.io/projected/43317211-20bd-4601-a018-0a40871dd9c4-kube-api-access-xdx5g\") pod \"authorino-56c6c9ddd5-2phtb\" (UID: \"43317211-20bd-4601-a018-0a40871dd9c4\") " pod="kuadrant-system/authorino-56c6c9ddd5-2phtb"
Oct 30 21:22:49.781734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:49.781660    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb"
Oct 30 21:22:50.154722 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:50.154698    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2phtb"]
Oct 30 21:22:50.157296 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:22:50.157256    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43317211_20bd_4601_a018_0a40871dd9c4.slice/crio-cfa863df5032f4e02928f5aa3e29618fa718dfe6a6c493f05d3aafe79de6ab47 WatchSource:0}: Error finding container cfa863df5032f4e02928f5aa3e29618fa718dfe6a6c493f05d3aafe79de6ab47: Status 404 returned error can't find the container with id cfa863df5032f4e02928f5aa3e29618fa718dfe6a6c493f05d3aafe79de6ab47
Oct 30 21:22:50.572670 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:50.572593    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb" event={"ID":"43317211-20bd-4601-a018-0a40871dd9c4","Type":"ContainerStarted","Data":"cfa863df5032f4e02928f5aa3e29618fa718dfe6a6c493f05d3aafe79de6ab47"}
Oct 30 21:22:50.608431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:50.608400    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:51.062667 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:22:51.062632    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:22:54.596930 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:54.596887    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb" event={"ID":"43317211-20bd-4601-a018-0a40871dd9c4","Type":"ContainerStarted","Data":"6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da"}
Oct 30 21:22:54.598454 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:54.598431    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-g6j5c" event={"ID":"b36f7317-db7d-4a79-98e1-a315cb64eea4","Type":"ContainerStarted","Data":"e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030"}
Oct 30 21:22:54.711446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:54.711397    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb" podStartSLOduration=2.316706013 podStartE2EDuration="5.711382769s" totalImagesPullingTime="3.394676756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:54.710774513 +0000 UTC m=+369.206347865" watchObservedRunningTime="2026-10-30 21:22:54.711382769 +0000 UTC m=+369.206956119"
Oct 30 21:22:54.762726 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:54.762693    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-g6j5c"]
Oct 30 21:22:54.824750 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:54.824675    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-g6j5c" podStartSLOduration=2.288079169 podStartE2EDuration="8.8246522s" totalImagesPullingTime="6.536573031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:54.823119657 +0000 UTC m=+369.318693009" watchObservedRunningTime="2026-10-30 21:22:54.8246522 +0000 UTC m=+369.320225553"
Oct 30 21:22:55.266799 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.266763    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"]
Oct 30 21:22:55.269227 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.269200    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.288471 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.288446    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5128c700-687b-465d-b116-549dc7ec9074-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.288628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.288492    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97q2k\" (UniqueName: \"kubernetes.io/projected/5128c700-687b-465d-b116-549dc7ec9074-kube-api-access-97q2k\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.288628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.288603    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5128c700-687b-465d-b116-549dc7ec9074-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.288701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.288658    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5128c700-687b-465d-b116-549dc7ec9074-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.321412 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.321384    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 30 21:22:55.370636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.370607    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-b9l5s\""
Oct 30 21:22:55.370786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.370675    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 30 21:22:55.389494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.389462    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97q2k\" (UniqueName: \"kubernetes.io/projected/5128c700-687b-465d-b116-549dc7ec9074-kube-api-access-97q2k\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.389653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.389515    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5128c700-687b-465d-b116-549dc7ec9074-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.389653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.389576    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5128c700-687b-465d-b116-549dc7ec9074-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.389653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.389602    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5128c700-687b-465d-b116-549dc7ec9074-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.389992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.389972    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5128c700-687b-465d-b116-549dc7ec9074-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.390039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.389973    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5128c700-687b-465d-b116-549dc7ec9074-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.470216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.470184    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 30 21:22:55.472533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.472503    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"]
Oct 30 21:22:55.472784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.472763    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97q2k\" (UniqueName: \"kubernetes.io/projected/5128c700-687b-465d-b116-549dc7ec9074-kube-api-access-97q2k\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.480964 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.480943    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5128c700-687b-465d-b116-549dc7ec9074-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-fhcnj\" (UID: \"5128c700-687b-465d-b116-549dc7ec9074\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:55.580542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:55.580473    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:56.007794 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:56.007767    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"]
Oct 30 21:22:56.009487 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:22:56.009460    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5128c700_687b_465d_b116_549dc7ec9074.slice/crio-46c767afbddd634a1821396fb7c31719a32ddea927c09f9608839dcd393a620c WatchSource:0}: Error finding container 46c767afbddd634a1821396fb7c31719a32ddea927c09f9608839dcd393a620c: Status 404 returned error can't find the container with id 46c767afbddd634a1821396fb7c31719a32ddea927c09f9608839dcd393a620c
Oct 30 21:22:56.610454 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:56.610414    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj" event={"ID":"5128c700-687b-465d-b116-549dc7ec9074","Type":"ContainerStarted","Data":"46c767afbddd634a1821396fb7c31719a32ddea927c09f9608839dcd393a620c"}
Oct 30 21:22:56.610751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:56.610575    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-g6j5c" podUID="b36f7317-db7d-4a79-98e1-a315cb64eea4" containerName="authorino" containerID="cri-o://e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030" gracePeriod=30
Oct 30 21:22:56.858478 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:56.858453    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-g6j5c"
Oct 30 21:22:56.909390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:56.909362    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b36f7317-db7d-4a79-98e1-a315cb64eea4-kube-api-access-8b5bw\" (UniqueName: \"kubernetes.io/projected/b36f7317-db7d-4a79-98e1-a315cb64eea4-kube-api-access-8b5bw\") pod \"b36f7317-db7d-4a79-98e1-a315cb64eea4\" (UID: \"b36f7317-db7d-4a79-98e1-a315cb64eea4\") "
Oct 30 21:22:56.911609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:56.911586    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b36f7317-db7d-4a79-98e1-a315cb64eea4-kube-api-access-8b5bw" pod "b36f7317-db7d-4a79-98e1-a315cb64eea4" (UID: "b36f7317-db7d-4a79-98e1-a315cb64eea4"). InnerVolumeSpecName "kube-api-access-8b5bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:22:57.010611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.010578    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b5bw\" (UniqueName: \"kubernetes.io/projected/b36f7317-db7d-4a79-98e1-a315cb64eea4-kube-api-access-8b5bw\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:22:57.622000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.621958    4943 generic.go:356] "Generic (PLEG): container finished" podID="b36f7317-db7d-4a79-98e1-a315cb64eea4" containerID="e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030" exitCode=0
Oct 30 21:22:57.622185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.622118    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-g6j5c" event={"ID":"b36f7317-db7d-4a79-98e1-a315cb64eea4","Type":"ContainerDied","Data":"e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030"}
Oct 30 21:22:57.622185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.622147    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-g6j5c" event={"ID":"b36f7317-db7d-4a79-98e1-a315cb64eea4","Type":"ContainerDied","Data":"a29ec6e83e9dff87ba12e7e5bce9b3acf047a5e4de44921572c44d4525fd4762"}
Oct 30 21:22:57.622185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.622163    4943 scope.go:122] "RemoveContainer" containerID="e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030"
Oct 30 21:22:57.622385 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.622288    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-g6j5c"
Oct 30 21:22:57.634934 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.634908    4943 scope.go:122] "RemoveContainer" containerID="e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030"
Oct 30 21:22:57.635444 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:22:57.635414    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030\": container with ID starting with e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030 not found: ID does not exist" containerID="e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030"
Oct 30 21:22:57.635587 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.635455    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030"} err="failed to get container status \"e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030\": rpc error: code = NotFound desc = could not find container \"e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030\": container with ID starting with e07ca945282073e329f4a7a943ab243a46b6f8b2c573799cc68530dea8fb2030 not found: ID does not exist"
Oct 30 21:22:57.785040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.785006    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-g6j5c"]
Oct 30 21:22:57.790513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:57.790484    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-g6j5c"]
Oct 30 21:22:59.243352 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:59.243319    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:59.416210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:59.416178    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:22:59.617107 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:59.617036    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b36f7317-db7d-4a79-98e1-a315cb64eea4" path="/var/lib/kubelet/pods/b36f7317-db7d-4a79-98e1-a315cb64eea4/volumes"
Oct 30 21:22:59.636101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:59.636072    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj" event={"ID":"5128c700-687b-465d-b116-549dc7ec9074","Type":"ContainerStarted","Data":"24e76c9bd3df669f376581c9e6fbefedd3a1e826bf6ba5a7509c65a3e53a0aa3"}
Oct 30 21:22:59.636253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:59.636205    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:22:59.802703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:22:59.802647    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj" podStartSLOduration=2.040583812 podStartE2EDuration="4.802633205s" totalImagesPullingTime="2.762049393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:22:59.800268911 +0000 UTC m=+374.295842262" watchObservedRunningTime="2026-10-30 21:22:59.802633205 +0000 UTC m=+374.298206555"
Oct 30 21:23:08.012621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:08.012583    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:08.198987 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:08.198951    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:08.769381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:08.769336    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:12.545195 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:12.545162    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:12.738240 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:12.738208    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:20.642390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:20.642354    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-fhcnj"
Oct 30 21:23:21.061807 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:23:21.061768    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:23:27.011831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:27.011756    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:38.284756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:38.284721    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:39.963654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:39.963613    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:40.153388 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.153327    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:40.340492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.340406    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:40.409225 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.409192    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-58d6bcb5f-zqwb8"]
Oct 30 21:23:40.409591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.409576    4943 cpu_manager.go:414] "containerMap: removing container" podUID="b36f7317-db7d-4a79-98e1-a315cb64eea4" containerName="authorino"
Oct 30 21:23:40.409642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.409592    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b36f7317-db7d-4a79-98e1-a315cb64eea4" containerName="authorino"
Oct 30 21:23:40.409683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.409673    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="b36f7317-db7d-4a79-98e1-a315cb64eea4" containerName="authorino"
Oct 30 21:23:40.413879 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.413860    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.467829 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.467801    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 30 21:23:40.517291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.517265    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 30 21:23:40.517291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.517283    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 30 21:23:40.517480 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.517377    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ffhp5\""
Oct 30 21:23:40.519504 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.519484    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58d6bcb5f-zqwb8"]
Oct 30 21:23:40.547767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.547745    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:40.577094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.577053    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-webhook-cert\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.577287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.577109    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m74rg\" (UniqueName: \"kubernetes.io/projected/8946ba66-fc18-4527-a27b-dd93cf55f850-kube-api-access-m74rg\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.577287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.577174    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-metrics-certs\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.677639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.677606    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m74rg\" (UniqueName: \"kubernetes.io/projected/8946ba66-fc18-4527-a27b-dd93cf55f850-kube-api-access-m74rg\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.677789 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.677645    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-metrics-certs\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.677789 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.677694    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-webhook-cert\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.680076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.680049    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-webhook-cert\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.680216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.680190    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-metrics-certs\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:40.734211 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:40.734189    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m74rg\" (UniqueName: \"kubernetes.io/projected/8946ba66-fc18-4527-a27b-dd93cf55f850-kube-api-access-m74rg\") pod \"maas-controller-58d6bcb5f-zqwb8\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") " pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:41.025611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:41.025502    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:41.402521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:41.402488    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-58d6bcb5f-zqwb8"]
Oct 30 21:23:41.404500 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:23:41.404459    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8946ba66_fc18_4527_a27b_dd93cf55f850.slice/crio-6370eaf453463396d389173889d25795536a8a150527e3b4dca7edc13cb0b2fc WatchSource:0}: Error finding container 6370eaf453463396d389173889d25795536a8a150527e3b4dca7edc13cb0b2fc: Status 404 returned error can't find the container with id 6370eaf453463396d389173889d25795536a8a150527e3b4dca7edc13cb0b2fc
Oct 30 21:23:41.854395 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:41.854306    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" event={"ID":"8946ba66-fc18-4527-a27b-dd93cf55f850","Type":"ContainerStarted","Data":"6370eaf453463396d389173889d25795536a8a150527e3b4dca7edc13cb0b2fc"}
Oct 30 21:23:44.209427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:44.209382    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:44.410694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:44.410665    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:44.875468 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:44.875427    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" event={"ID":"8946ba66-fc18-4527-a27b-dd93cf55f850","Type":"ContainerStarted","Data":"459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152"}
Oct 30 21:23:44.875682 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:44.875598    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:23:44.993060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:44.993012    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" podStartSLOduration=2.145994003 podStartE2EDuration="4.992997726s" totalImagesPullingTime="2.847003723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:23:44.991714622 +0000 UTC m=+419.487287974" watchObservedRunningTime="2026-10-30 21:23:44.992997726 +0000 UTC m=+419.488571081"
Oct 30 21:23:47.261915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.261877    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"]
Oct 30 21:23:47.272727 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.272692    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.331235 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.331201    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"]
Oct 30 21:23:47.341703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.341672    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.341703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.341704    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsp8d\" (UniqueName: \"kubernetes.io/projected/d19bb9ca-7514-4908-84eb-334ff4e55594-kube-api-access-vsp8d\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.341887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.341866    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.341921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.341910    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d19bb9ca-7514-4908-84eb-334ff4e55594-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.377373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.377330    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\""
Oct 30 21:23:47.377529 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.377450    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\""
Oct 30 21:23:47.378242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.378225    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\""
Oct 30 21:23:47.378283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.378231    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-22fc6\""
Oct 30 21:23:47.442757 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.442722    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.442924 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.442769    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d19bb9ca-7514-4908-84eb-334ff4e55594-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.442924 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.442817    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.442924 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:23:47.442845    4943 configmap.go:193] Couldn't get configMap opendatahub/usage-tenancy-proxy-source: configmap "usage-tenancy-proxy-source" not found
Oct 30 21:23:47.442924 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:23:47.442922    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-proxy-source podName:d19bb9ca-7514-4908-84eb-334ff4e55594 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:47.942902294 +0000 UTC m=+422.438475638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-source" (UniqueName: "kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-proxy-source") pod "usage-logs-tenancy-proxy-9c5d49bcd-6rnx4" (UID: "d19bb9ca-7514-4908-84eb-334ff4e55594") : configmap "usage-tenancy-proxy-source" not found
Oct 30 21:23:47.443159 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:23:47.442958    4943 secret.go:189] Couldn't get secret opendatahub/usage-logs-tenancy-proxy-tls: secret "usage-logs-tenancy-proxy-tls" not found
Oct 30 21:23:47.443159 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:23:47.443046    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d19bb9ca-7514-4908-84eb-334ff4e55594-tls-cert podName:d19bb9ca-7514-4908-84eb-334ff4e55594 nodeName:}" failed. No retries permitted until 2026-10-30 21:23:47.943027585 +0000 UTC m=+422.438600928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-cert" (UniqueName: "kubernetes.io/secret/d19bb9ca-7514-4908-84eb-334ff4e55594-tls-cert") pod "usage-logs-tenancy-proxy-9c5d49bcd-6rnx4" (UID: "d19bb9ca-7514-4908-84eb-334ff4e55594") : secret "usage-logs-tenancy-proxy-tls" not found
Oct 30 21:23:47.443159 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.442847    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsp8d\" (UniqueName: \"kubernetes.io/projected/d19bb9ca-7514-4908-84eb-334ff4e55594-kube-api-access-vsp8d\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.443528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.443509    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.453172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.453146    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:47.501859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.501834    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsp8d\" (UniqueName: \"kubernetes.io/projected/d19bb9ca-7514-4908-84eb-334ff4e55594-kube-api-access-vsp8d\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.640054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.639976    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:23:47.948115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.948077    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.948307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.948134    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d19bb9ca-7514-4908-84eb-334ff4e55594-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.948917 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.948891    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/d19bb9ca-7514-4908-84eb-334ff4e55594-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:47.950595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:47.950574    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d19bb9ca-7514-4908-84eb-334ff4e55594-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6rnx4\" (UID: \"d19bb9ca-7514-4908-84eb-334ff4e55594\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:48.186629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:48.186591    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:23:48.568356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:48.568333    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"]
Oct 30 21:23:48.570340 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:23:48.570307    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19bb9ca_7514_4908_84eb_334ff4e55594.slice/crio-5395d210ded91157cf97fb4da0c9e6fe6ac53a3634c7c003c249aeabe6dc0568 WatchSource:0}: Error finding container 5395d210ded91157cf97fb4da0c9e6fe6ac53a3634c7c003c249aeabe6dc0568: Status 404 returned error can't find the container with id 5395d210ded91157cf97fb4da0c9e6fe6ac53a3634c7c003c249aeabe6dc0568
Oct 30 21:23:48.897174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:48.897084    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4" event={"ID":"d19bb9ca-7514-4908-84eb-334ff4e55594","Type":"ContainerStarted","Data":"5395d210ded91157cf97fb4da0c9e6fe6ac53a3634c7c003c249aeabe6dc0568"}
Oct 30 21:23:51.061775 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:23:51.061740    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:23:55.882961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:23:55.882932    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:24:01.132040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:01.131997    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:01.325754 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:01.325678    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:01.507039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:01.506862    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:01.681604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:01.681540    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:01.884059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:01.883982    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:02.022447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.022412    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"]
Oct 30 21:24:02.056312 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.056265    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:02.149460 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.149401    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"]
Oct 30 21:24:02.149912 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.149543    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.184284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.184249    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1c9bb5-f909-446c-b067-d1dcf2507a25-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7ps4q\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.184520 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.184290    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wks9x\" (UniqueName: \"kubernetes.io/projected/ea1c9bb5-f909-446c-b067-d1dcf2507a25-kube-api-access-wks9x\") pod \"llmisvc-controller-manager-869d5dcc5d-7ps4q\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.285546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.285508    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1c9bb5-f909-446c-b067-d1dcf2507a25-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7ps4q\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.285546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.285546    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wks9x\" (UniqueName: \"kubernetes.io/projected/ea1c9bb5-f909-446c-b067-d1dcf2507a25-kube-api-access-wks9x\") pod \"llmisvc-controller-manager-869d5dcc5d-7ps4q\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.309719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.309669    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n5m2k\""
Oct 30 21:24:02.309719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.309692    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 30 21:24:02.319471 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.319440    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1c9bb5-f909-446c-b067-d1dcf2507a25-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-7ps4q\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.341884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.341857    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wks9x\" (UniqueName: \"kubernetes.io/projected/ea1c9bb5-f909-446c-b067-d1dcf2507a25-kube-api-access-wks9x\") pod \"llmisvc-controller-manager-869d5dcc5d-7ps4q\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.484372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.484299    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:02.908111 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:02.908068    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"]
Oct 30 21:24:03.087542 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:24:03.087506    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podea1c9bb5_f909_446c_b067_d1dcf2507a25.slice/crio-40ed6e32637b81da70e699617b67f9a249754d282f92ba999698a71f6326bfe4 WatchSource:0}: Error finding container 40ed6e32637b81da70e699617b67f9a249754d282f92ba999698a71f6326bfe4: Status 404 returned error can't find the container with id 40ed6e32637b81da70e699617b67f9a249754d282f92ba999698a71f6326bfe4
Oct 30 21:24:03.402188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:03.402160    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:03.579036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:03.578968    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:03.987713 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:03.987678    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4" event={"ID":"d19bb9ca-7514-4908-84eb-334ff4e55594","Type":"ContainerStarted","Data":"af47caff77983cae8a1e34e3f2925519de5a922e361955b26d3ebf158a5a504b"}
Oct 30 21:24:03.987880 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:03.987853    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:24:03.988916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:03.988894    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q" event={"ID":"ea1c9bb5-f909-446c-b067-d1dcf2507a25","Type":"ContainerStarted","Data":"40ed6e32637b81da70e699617b67f9a249754d282f92ba999698a71f6326bfe4"}
Oct 30 21:24:04.103950 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:04.103893    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4" podStartSLOduration=2.533863587 podStartE2EDuration="17.103876392s" totalImagesPullingTime="14.570012805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:04.101917557 +0000 UTC m=+438.597490908" watchObservedRunningTime="2026-10-30 21:24:04.103876392 +0000 UTC m=+438.599449743"
Oct 30 21:24:06.000317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:06.000281    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q" event={"ID":"ea1c9bb5-f909-446c-b067-d1dcf2507a25","Type":"ContainerStarted","Data":"a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952"}
Oct 30 21:24:06.000827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:06.000410    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:06.117429 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:06.117336    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q" podStartSLOduration=2.445377571 podStartE2EDuration="5.117322924s" totalImagesPullingTime="2.671945353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:06.114974052 +0000 UTC m=+440.610547403" watchObservedRunningTime="2026-10-30 21:24:06.117322924 +0000 UTC m=+440.612896275"
Oct 30 21:24:08.368981 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:08.368946    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:08.544429 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:08.544398    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:08.719127 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:08.719096    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:08.891521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:08.891478    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:09.067002 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:09.066921    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:09.305104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:09.305073    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:09.479218 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:09.479186    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:09.648035 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:09.648003    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:14.999221 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:14.999191    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6rnx4"
Oct 30 21:24:16.340460 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:16.340425    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:16.552463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:16.552430    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:18.442186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:18.442153    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:18.653550 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:18.653517    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:18.842103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:18.842021    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:19.030427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:19.030395    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:21.063592 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:24:21.063535    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:24:29.541678 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:29.541637    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:29.782544 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:29.782511    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:29.813859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:29.813793    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4mb69"]
Oct 30 21:24:29.817255 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:29.817237    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4mb69"
Oct 30 21:24:29.873048 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:29.873011    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4mb69"]
Oct 30 21:24:29.921971 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:29.921941    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpb6m\" (UniqueName: \"kubernetes.io/projected/304134d2-c443-4c32-a580-14ba065afd01-kube-api-access-zpb6m\") pod \"authorino-6f6944bcdd-4mb69\" (UID: \"304134d2-c443-4c32-a580-14ba065afd01\") " pod="kuadrant-system/authorino-6f6944bcdd-4mb69"
Oct 30 21:24:30.023239 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.023204    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpb6m\" (UniqueName: \"kubernetes.io/projected/304134d2-c443-4c32-a580-14ba065afd01-kube-api-access-zpb6m\") pod \"authorino-6f6944bcdd-4mb69\" (UID: \"304134d2-c443-4c32-a580-14ba065afd01\") " pod="kuadrant-system/authorino-6f6944bcdd-4mb69"
Oct 30 21:24:30.079639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.079573    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpb6m\" (UniqueName: \"kubernetes.io/projected/304134d2-c443-4c32-a580-14ba065afd01-kube-api-access-zpb6m\") pod \"authorino-6f6944bcdd-4mb69\" (UID: \"304134d2-c443-4c32-a580-14ba065afd01\") " pod="kuadrant-system/authorino-6f6944bcdd-4mb69"
Oct 30 21:24:30.128999 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.128960    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4mb69"
Oct 30 21:24:30.176403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.176366    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4mb69"]
Oct 30 21:24:30.195923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.195891    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67b47c54d7-5lqr7"]
Oct 30 21:24:30.199513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.199490    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b47c54d7-5lqr7"
Oct 30 21:24:30.271862 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.271796    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67b47c54d7-5lqr7"]
Oct 30 21:24:30.327909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.327879    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9299\" (UniqueName: \"kubernetes.io/projected/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc-kube-api-access-r9299\") pod \"authorino-67b47c54d7-5lqr7\" (UID: \"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc\") " pod="kuadrant-system/authorino-67b47c54d7-5lqr7"
Oct 30 21:24:30.428876 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.428843    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9299\" (UniqueName: \"kubernetes.io/projected/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc-kube-api-access-r9299\") pod \"authorino-67b47c54d7-5lqr7\" (UID: \"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc\") " pod="kuadrant-system/authorino-67b47c54d7-5lqr7"
Oct 30 21:24:30.485881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.485852    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9299\" (UniqueName: \"kubernetes.io/projected/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc-kube-api-access-r9299\") pod \"authorino-67b47c54d7-5lqr7\" (UID: \"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc\") " pod="kuadrant-system/authorino-67b47c54d7-5lqr7"
Oct 30 21:24:30.517755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.517725    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b47c54d7-5lqr7"
Oct 30 21:24:30.530129 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.530104    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4mb69"]
Oct 30 21:24:30.532015 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:24:30.531990    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod304134d2_c443_4c32_a580_14ba065afd01.slice/crio-351109d7ad6c2d49edb963efc4db660294bc93e0590cf8dad25df75c0679570c WatchSource:0}: Error finding container 351109d7ad6c2d49edb963efc4db660294bc93e0590cf8dad25df75c0679570c: Status 404 returned error can't find the container with id 351109d7ad6c2d49edb963efc4db660294bc93e0590cf8dad25df75c0679570c
Oct 30 21:24:30.633465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.632257    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67b47c54d7-5lqr7"]
Oct 30 21:24:30.672808 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.672773    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76d6c4d689-p6vdg"]
Oct 30 21:24:30.682111 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.682050    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:30.720034 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.720006    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76d6c4d689-p6vdg"]
Oct 30 21:24:30.733766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.733742    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 30 21:24:30.834207 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.834178    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt97h\" (UniqueName: \"kubernetes.io/projected/8c90a860-0776-452e-9964-4ada9cf28c53-kube-api-access-bt97h\") pod \"authorino-76d6c4d689-p6vdg\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") " pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:30.834353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.834218    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c90a860-0776-452e-9964-4ada9cf28c53-tls-cert\") pod \"authorino-76d6c4d689-p6vdg\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") " pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:30.935756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.935724    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt97h\" (UniqueName: \"kubernetes.io/projected/8c90a860-0776-452e-9964-4ada9cf28c53-kube-api-access-bt97h\") pod \"authorino-76d6c4d689-p6vdg\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") " pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:30.935836 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.935789    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c90a860-0776-452e-9964-4ada9cf28c53-tls-cert\") pod \"authorino-76d6c4d689-p6vdg\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") " pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:30.935836 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.935818    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67b47c54d7-5lqr7"]
Oct 30 21:24:30.938362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.938341    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c90a860-0776-452e-9964-4ada9cf28c53-tls-cert\") pod \"authorino-76d6c4d689-p6vdg\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") " pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:30.938459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:24:30.938392    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode55a7e6b_26db_4ad9_aff8_738c7d78fcdc.slice/crio-4b4739f924583cd0143520af4c384e6194b9c9f415c66027ccaf697d664093dc WatchSource:0}: Error finding container 4b4739f924583cd0143520af4c384e6194b9c9f415c66027ccaf697d664093dc: Status 404 returned error can't find the container with id 4b4739f924583cd0143520af4c384e6194b9c9f415c66027ccaf697d664093dc
Oct 30 21:24:30.992011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.991982    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt97h\" (UniqueName: \"kubernetes.io/projected/8c90a860-0776-452e-9964-4ada9cf28c53-kube-api-access-bt97h\") pod \"authorino-76d6c4d689-p6vdg\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") " pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:30.997874 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:30.997853    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:24:31.141064 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:31.141031    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b47c54d7-5lqr7" event={"ID":"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc","Type":"ContainerStarted","Data":"4b4739f924583cd0143520af4c384e6194b9c9f415c66027ccaf697d664093dc"}
Oct 30 21:24:31.142402 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:31.142374    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-4mb69" event={"ID":"304134d2-c443-4c32-a580-14ba065afd01","Type":"ContainerStarted","Data":"351109d7ad6c2d49edb963efc4db660294bc93e0590cf8dad25df75c0679570c"}
Oct 30 21:24:31.424627 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:31.424596    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76d6c4d689-p6vdg"]
Oct 30 21:24:31.427201 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:24:31.427168    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c90a860_0776_452e_9964_4ada9cf28c53.slice/crio-7203f3e46ead9db5b009abffa78056b79ec1a9f299919d0502473f3591a3dac6 WatchSource:0}: Error finding container 7203f3e46ead9db5b009abffa78056b79ec1a9f299919d0502473f3591a3dac6: Status 404 returned error can't find the container with id 7203f3e46ead9db5b009abffa78056b79ec1a9f299919d0502473f3591a3dac6
Oct 30 21:24:32.150368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:32.150321    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d6c4d689-p6vdg" event={"ID":"8c90a860-0776-452e-9964-4ada9cf28c53","Type":"ContainerStarted","Data":"7203f3e46ead9db5b009abffa78056b79ec1a9f299919d0502473f3591a3dac6"}
Oct 30 21:24:33.158259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.158177    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d6c4d689-p6vdg" event={"ID":"8c90a860-0776-452e-9964-4ada9cf28c53","Type":"ContainerStarted","Data":"79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3"}
Oct 30 21:24:33.159915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.159884    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b47c54d7-5lqr7" event={"ID":"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc","Type":"ContainerStarted","Data":"0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226"}
Oct 30 21:24:33.159915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.159884    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-67b47c54d7-5lqr7" podUID="e55a7e6b-26db-4ad9-aff8-738c7d78fcdc" containerName="authorino" containerID="cri-o://0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226" gracePeriod=30
Oct 30 21:24:33.161665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.161643    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-4mb69" event={"ID":"304134d2-c443-4c32-a580-14ba065afd01","Type":"ContainerStarted","Data":"d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e"}
Oct 30 21:24:33.161791 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.161766    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-4mb69" podUID="304134d2-c443-4c32-a580-14ba065afd01" containerName="authorino" containerID="cri-o://d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e" gracePeriod=30
Oct 30 21:24:33.270404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.270318    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-76d6c4d689-p6vdg" podStartSLOduration=1.795048655 podStartE2EDuration="3.270300176s" totalImagesPullingTime="1.475251521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:33.269644265 +0000 UTC m=+467.765217615" watchObservedRunningTime="2026-10-30 21:24:33.270300176 +0000 UTC m=+467.765873528"
Oct 30 21:24:33.294398 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.294364    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2phtb"]
Oct 30 21:24:33.294598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.294579    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb" podUID="43317211-20bd-4601-a018-0a40871dd9c4" containerName="authorino" containerID="cri-o://6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da" gracePeriod=30
Oct 30 21:24:33.384119 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.384050    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-4mb69" podStartSLOduration=2.310571059 podStartE2EDuration="4.383985071s" totalImagesPullingTime="2.073414012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:33.381833515 +0000 UTC m=+467.877406867" watchObservedRunningTime="2026-10-30 21:24:33.383985071 +0000 UTC m=+467.879558423"
Oct 30 21:24:33.502659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.502612    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-67b47c54d7-5lqr7" podStartSLOduration=1.803721088 podStartE2EDuration="3.502597126s" totalImagesPullingTime="1.698876038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:24:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:24:33.497854204 +0000 UTC m=+467.993427554" watchObservedRunningTime="2026-10-30 21:24:33.502597126 +0000 UTC m=+467.998170468"
Oct 30 21:24:33.508433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.508343    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b47c54d7-5lqr7"
Oct 30 21:24:33.512468 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.512445    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4mb69"
Oct 30 21:24:33.593565 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.593519    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb"
Oct 30 21:24:33.664104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.664062    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/304134d2-c443-4c32-a580-14ba065afd01-kube-api-access-zpb6m\" (UniqueName: \"kubernetes.io/projected/304134d2-c443-4c32-a580-14ba065afd01-kube-api-access-zpb6m\") pod \"304134d2-c443-4c32-a580-14ba065afd01\" (UID: \"304134d2-c443-4c32-a580-14ba065afd01\") "
Oct 30 21:24:33.664322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.664138    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc-kube-api-access-r9299\" (UniqueName: \"kubernetes.io/projected/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc-kube-api-access-r9299\") pod \"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc\" (UID: \"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc\") "
Oct 30 21:24:33.664322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.664225    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43317211-20bd-4601-a018-0a40871dd9c4-kube-api-access-xdx5g\" (UniqueName: \"kubernetes.io/projected/43317211-20bd-4601-a018-0a40871dd9c4-kube-api-access-xdx5g\") pod \"43317211-20bd-4601-a018-0a40871dd9c4\" (UID: \"43317211-20bd-4601-a018-0a40871dd9c4\") "
Oct 30 21:24:33.668255 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.667155    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43317211-20bd-4601-a018-0a40871dd9c4-kube-api-access-xdx5g" pod "43317211-20bd-4601-a018-0a40871dd9c4" (UID: "43317211-20bd-4601-a018-0a40871dd9c4"). InnerVolumeSpecName "kube-api-access-xdx5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:33.669117 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.669075    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc-kube-api-access-r9299" pod "e55a7e6b-26db-4ad9-aff8-738c7d78fcdc" (UID: "e55a7e6b-26db-4ad9-aff8-738c7d78fcdc"). InnerVolumeSpecName "kube-api-access-r9299". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:33.669514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.669486    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/304134d2-c443-4c32-a580-14ba065afd01-kube-api-access-zpb6m" pod "304134d2-c443-4c32-a580-14ba065afd01" (UID: "304134d2-c443-4c32-a580-14ba065afd01"). InnerVolumeSpecName "kube-api-access-zpb6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:24:33.765640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.765545    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9299\" (UniqueName: \"kubernetes.io/projected/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc-kube-api-access-r9299\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:33.765640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.765591    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdx5g\" (UniqueName: \"kubernetes.io/projected/43317211-20bd-4601-a018-0a40871dd9c4-kube-api-access-xdx5g\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:33.765640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:33.765607    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpb6m\" (UniqueName: \"kubernetes.io/projected/304134d2-c443-4c32-a580-14ba065afd01-kube-api-access-zpb6m\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:24:34.170063 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.170012    4943 generic.go:356] "Generic (PLEG): container finished" podID="304134d2-c443-4c32-a580-14ba065afd01" containerID="d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e" exitCode=0
Oct 30 21:24:34.170063 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.170062    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-4mb69"
Oct 30 21:24:34.170690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.170098    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-4mb69" event={"ID":"304134d2-c443-4c32-a580-14ba065afd01","Type":"ContainerDied","Data":"d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e"}
Oct 30 21:24:34.170690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.170140    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-4mb69" event={"ID":"304134d2-c443-4c32-a580-14ba065afd01","Type":"ContainerDied","Data":"351109d7ad6c2d49edb963efc4db660294bc93e0590cf8dad25df75c0679570c"}
Oct 30 21:24:34.170690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.170161    4943 scope.go:122] "RemoveContainer" containerID="d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e"
Oct 30 21:24:34.171925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.171904    4943 generic.go:356] "Generic (PLEG): container finished" podID="43317211-20bd-4601-a018-0a40871dd9c4" containerID="6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da" exitCode=0
Oct 30 21:24:34.172017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.171947    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb"
Oct 30 21:24:34.172546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.171999    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb" event={"ID":"43317211-20bd-4601-a018-0a40871dd9c4","Type":"ContainerDied","Data":"6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da"}
Oct 30 21:24:34.172546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.172378    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-2phtb" event={"ID":"43317211-20bd-4601-a018-0a40871dd9c4","Type":"ContainerDied","Data":"cfa863df5032f4e02928f5aa3e29618fa718dfe6a6c493f05d3aafe79de6ab47"}
Oct 30 21:24:34.182691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.176212    4943 generic.go:356] "Generic (PLEG): container finished" podID="e55a7e6b-26db-4ad9-aff8-738c7d78fcdc" containerID="0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226" exitCode=0
Oct 30 21:24:34.182691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.176844    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b47c54d7-5lqr7"
Oct 30 21:24:34.182691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.181924    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b47c54d7-5lqr7" event={"ID":"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc","Type":"ContainerDied","Data":"0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226"}
Oct 30 21:24:34.182691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.181962    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67b47c54d7-5lqr7" event={"ID":"e55a7e6b-26db-4ad9-aff8-738c7d78fcdc","Type":"ContainerDied","Data":"4b4739f924583cd0143520af4c384e6194b9c9f415c66027ccaf697d664093dc"}
Oct 30 21:24:34.193607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.193492    4943 scope.go:122] "RemoveContainer" containerID="d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e"
Oct 30 21:24:34.193972 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:24:34.193948    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e\": container with ID starting with d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e not found: ID does not exist" containerID="d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e"
Oct 30 21:24:34.194020 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.193982    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e"} err="failed to get container status \"d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e\": rpc error: code = NotFound desc = could not find container \"d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e\": container with ID starting with d01cf16b47d50cc03542281a324b3b89bc071bb69f64df37951b2ca80759ee2e not found: ID does not exist"
Oct 30 21:24:34.194020 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.193999    4943 scope.go:122] "RemoveContainer" containerID="6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da"
Oct 30 21:24:34.207263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.207243    4943 scope.go:122] "RemoveContainer" containerID="6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da"
Oct 30 21:24:34.207625 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:24:34.207608    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da\": container with ID starting with 6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da not found: ID does not exist" containerID="6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da"
Oct 30 21:24:34.207693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.207640    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da"} err="failed to get container status \"6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da\": rpc error: code = NotFound desc = could not find container \"6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da\": container with ID starting with 6276b3ce0e673f2b1a2e2fb676f82496e9571508d8ed1394201ba7014f1ed8da not found: ID does not exist"
Oct 30 21:24:34.207693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.207656    4943 scope.go:122] "RemoveContainer" containerID="0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226"
Oct 30 21:24:34.215982 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.215960    4943 scope.go:122] "RemoveContainer" containerID="0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226"
Oct 30 21:24:34.216323 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:24:34.216301    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226\": container with ID starting with 0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226 not found: ID does not exist" containerID="0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226"
Oct 30 21:24:34.216414 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.216331    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226"} err="failed to get container status \"0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226\": rpc error: code = NotFound desc = could not find container \"0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226\": container with ID starting with 0c8eb37be4a6c87d412ff7eab04df940e7287e70575b181685a031bc202e7226 not found: ID does not exist"
Oct 30 21:24:34.332540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.332501    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2phtb"]
Oct 30 21:24:34.334706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.334685    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-2phtb"]
Oct 30 21:24:34.442609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.442517    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4mb69"]
Oct 30 21:24:34.445914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.445890    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-4mb69"]
Oct 30 21:24:34.553917 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.553877    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67b47c54d7-5lqr7"]
Oct 30 21:24:34.559572 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:34.559535    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67b47c54d7-5lqr7"]
Oct 30 21:24:35.184187 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.184152    4943 generic.go:356] "Generic (PLEG): container finished" podID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerID="0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273" exitCode=0
Oct 30 21:24:35.184710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.184224    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" event={"ID":"b3788014-47c8-491d-8f92-18bf1b08c7d3","Type":"ContainerDied","Data":"0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273"}
Oct 30 21:24:35.184710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.184665    4943 scope.go:122] "RemoveContainer" containerID="0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273"
Oct 30 21:24:35.185859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.185825    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:24:35.185985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.185899    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:24:35.185985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.185934    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:24:35.617646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.617544    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="304134d2-c443-4c32-a580-14ba065afd01" path="/var/lib/kubelet/pods/304134d2-c443-4c32-a580-14ba065afd01/volumes"
Oct 30 21:24:35.617910 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.617896    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="43317211-20bd-4601-a018-0a40871dd9c4" path="/var/lib/kubelet/pods/43317211-20bd-4601-a018-0a40871dd9c4/volumes"
Oct 30 21:24:35.618199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:35.618187    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e55a7e6b-26db-4ad9-aff8-738c7d78fcdc" path="/var/lib/kubelet/pods/e55a7e6b-26db-4ad9-aff8-738c7d78fcdc/volumes"
Oct 30 21:24:36.193083 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:36.193050    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" event={"ID":"b3788014-47c8-491d-8f92-18bf1b08c7d3","Type":"ContainerStarted","Data":"0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf"}
Oct 30 21:24:37.008039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:37.008004    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:24:37.010480 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:37.010461    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:24:37.011184 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:37.011158    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:24:37.011273 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:37.011213    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 30 21:24:38.010022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:38.009986    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:24:38.010426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:38.010046    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 30 21:24:38.632960 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:38.632880    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:24:39.010739 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:39.010704    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:24:39.011179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:39.010766    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 30 21:24:39.837533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:39.837494    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:24:40.010021 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:40.009986    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:24:40.010188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:40.010045    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 30 21:24:41.010700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:41.010661    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-fcgrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 30 21:24:41.011171 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:41.010725    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 30 21:24:42.013907 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:42.013879    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:24:42.015080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:42.015060    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:24:51.061933 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:24:51.061897    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:24:59.631515 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:24:59.631436    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:14.589103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589063    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"]
Oct 30 21:25:14.589511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589445    4943 cpu_manager.go:414] "containerMap: removing container" podUID="304134d2-c443-4c32-a580-14ba065afd01" containerName="authorino"
Oct 30 21:25:14.589511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589456    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="304134d2-c443-4c32-a580-14ba065afd01" containerName="authorino"
Oct 30 21:25:14.589511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589477    4943 cpu_manager.go:414] "containerMap: removing container" podUID="e55a7e6b-26db-4ad9-aff8-738c7d78fcdc" containerName="authorino"
Oct 30 21:25:14.589511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589482    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e55a7e6b-26db-4ad9-aff8-738c7d78fcdc" containerName="authorino"
Oct 30 21:25:14.589511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589500    4943 cpu_manager.go:414] "containerMap: removing container" podUID="43317211-20bd-4601-a018-0a40871dd9c4" containerName="authorino"
Oct 30 21:25:14.589511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589505    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43317211-20bd-4601-a018-0a40871dd9c4" containerName="authorino"
Oct 30 21:25:14.589729 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589601    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="43317211-20bd-4601-a018-0a40871dd9c4" containerName="authorino"
Oct 30 21:25:14.589729 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589615    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="304134d2-c443-4c32-a580-14ba065afd01" containerName="authorino"
Oct 30 21:25:14.589729 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.589625    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="e55a7e6b-26db-4ad9-aff8-738c7d78fcdc" containerName="authorino"
Oct 30 21:25:14.591817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.591802    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:14.602647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.602624    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d931a613-5a33-4403-83f9-a81d96e2bb19-cert\") pod \"llmisvc-controller-manager-6466c554d8-z8m9g\" (UID: \"d931a613-5a33-4403-83f9-a81d96e2bb19\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:14.602739 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.602664    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5gt5\" (UniqueName: \"kubernetes.io/projected/d931a613-5a33-4403-83f9-a81d96e2bb19-kube-api-access-z5gt5\") pod \"llmisvc-controller-manager-6466c554d8-z8m9g\" (UID: \"d931a613-5a33-4403-83f9-a81d96e2bb19\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:14.651949 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.651907    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"]
Oct 30 21:25:14.703955 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.703918    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d931a613-5a33-4403-83f9-a81d96e2bb19-cert\") pod \"llmisvc-controller-manager-6466c554d8-z8m9g\" (UID: \"d931a613-5a33-4403-83f9-a81d96e2bb19\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:14.704125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.703981    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5gt5\" (UniqueName: \"kubernetes.io/projected/d931a613-5a33-4403-83f9-a81d96e2bb19-kube-api-access-z5gt5\") pod \"llmisvc-controller-manager-6466c554d8-z8m9g\" (UID: \"d931a613-5a33-4403-83f9-a81d96e2bb19\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:14.706771 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.706742    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d931a613-5a33-4403-83f9-a81d96e2bb19-cert\") pod \"llmisvc-controller-manager-6466c554d8-z8m9g\" (UID: \"d931a613-5a33-4403-83f9-a81d96e2bb19\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:14.761400 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.761370    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5gt5\" (UniqueName: \"kubernetes.io/projected/d931a613-5a33-4403-83f9-a81d96e2bb19-kube-api-access-z5gt5\") pod \"llmisvc-controller-manager-6466c554d8-z8m9g\" (UID: \"d931a613-5a33-4403-83f9-a81d96e2bb19\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:14.903524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:14.903500    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:15.278969 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:15.278943    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"]
Oct 30 21:25:15.280776 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:25:15.280741    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd931a613_5a33_4403_83f9_a81d96e2bb19.slice/crio-2b794632ee08a6495d6ab4f0f4ce71a3b0773a234cf87f469b77cc6c029c56d7 WatchSource:0}: Error finding container 2b794632ee08a6495d6ab4f0f4ce71a3b0773a234cf87f469b77cc6c029c56d7: Status 404 returned error can't find the container with id 2b794632ee08a6495d6ab4f0f4ce71a3b0773a234cf87f469b77cc6c029c56d7
Oct 30 21:25:15.410604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:15.410550    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g" event={"ID":"d931a613-5a33-4403-83f9-a81d96e2bb19","Type":"ContainerStarted","Data":"2b794632ee08a6495d6ab4f0f4ce71a3b0773a234cf87f469b77cc6c029c56d7"}
Oct 30 21:25:16.417660 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:16.417618    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g" event={"ID":"d931a613-5a33-4403-83f9-a81d96e2bb19","Type":"ContainerStarted","Data":"62dc39ff6e68db07abcba233a0f127b4a20dea39fc2cdf723e28c292e5dd7a73"}
Oct 30 21:25:16.418071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:16.417809    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:16.532160 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:16.532111    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g" podStartSLOduration=1.668825031 podStartE2EDuration="2.532095984s" totalImagesPullingTime="863.270953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:25:16.529995295 +0000 UTC m=+511.025568646" watchObservedRunningTime="2026-10-30 21:25:16.532095984 +0000 UTC m=+511.027669334"
Oct 30 21:25:17.275136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:17.275098    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:18.749695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:18.749651    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:21.061742 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:25:21.061708    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:25:38.969057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:38.969018    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:47.425469 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.425437    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-z8m9g"
Oct 30 21:25:47.593515 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.593480    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"]
Oct 30 21:25:47.593735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.593697    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q" podUID="ea1c9bb5-f909-446c-b067-d1dcf2507a25" containerName="manager" containerID="cri-o://a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952" gracePeriod=30
Oct 30 21:25:47.831792 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.831770    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:25:47.982683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.982604    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ea1c9bb5-f909-446c-b067-d1dcf2507a25-cert\" (UniqueName: \"kubernetes.io/secret/ea1c9bb5-f909-446c-b067-d1dcf2507a25-cert\") pod \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") "
Oct 30 21:25:47.982683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.982645    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ea1c9bb5-f909-446c-b067-d1dcf2507a25-kube-api-access-wks9x\" (UniqueName: \"kubernetes.io/projected/ea1c9bb5-f909-446c-b067-d1dcf2507a25-kube-api-access-wks9x\") pod \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\" (UID: \"ea1c9bb5-f909-446c-b067-d1dcf2507a25\") "
Oct 30 21:25:47.984813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.984783    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea1c9bb5-f909-446c-b067-d1dcf2507a25-cert" pod "ea1c9bb5-f909-446c-b067-d1dcf2507a25" (UID: "ea1c9bb5-f909-446c-b067-d1dcf2507a25"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:25:47.984813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:47.984788    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea1c9bb5-f909-446c-b067-d1dcf2507a25-kube-api-access-wks9x" pod "ea1c9bb5-f909-446c-b067-d1dcf2507a25" (UID: "ea1c9bb5-f909-446c-b067-d1dcf2507a25"). InnerVolumeSpecName "kube-api-access-wks9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:25:48.083474 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.083442    4943 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea1c9bb5-f909-446c-b067-d1dcf2507a25-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:48.083474 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.083470    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wks9x\" (UniqueName: \"kubernetes.io/projected/ea1c9bb5-f909-446c-b067-d1dcf2507a25-kube-api-access-wks9x\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:25:48.454696 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.454661    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:48.592851 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.592822    4943 generic.go:356] "Generic (PLEG): container finished" podID="ea1c9bb5-f909-446c-b067-d1dcf2507a25" containerID="a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952" exitCode=0
Oct 30 21:25:48.593006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.592865    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"
Oct 30 21:25:48.593006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.592893    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q" event={"ID":"ea1c9bb5-f909-446c-b067-d1dcf2507a25","Type":"ContainerDied","Data":"a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952"}
Oct 30 21:25:48.593006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.592941    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q" event={"ID":"ea1c9bb5-f909-446c-b067-d1dcf2507a25","Type":"ContainerDied","Data":"40ed6e32637b81da70e699617b67f9a249754d282f92ba999698a71f6326bfe4"}
Oct 30 21:25:48.593006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.592963    4943 scope.go:122] "RemoveContainer" containerID="a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952"
Oct 30 21:25:48.602383 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.602237    4943 scope.go:122] "RemoveContainer" containerID="a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952"
Oct 30 21:25:48.602509 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:25:48.602491    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952\": container with ID starting with a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952 not found: ID does not exist" containerID="a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952"
Oct 30 21:25:48.602547 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.602518    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952"} err="failed to get container status \"a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952\": rpc error: code = NotFound desc = could not find container \"a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952\": container with ID starting with a95b298b8cebba4feedaf5696900e98713f2fd9bb3a051aceca609b5262f6952 not found: ID does not exist"
Oct 30 21:25:48.646032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.646010    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:25:48.770625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.770572    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"]
Oct 30 21:25:48.820140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:48.820114    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-7ps4q"]
Oct 30 21:25:49.616782 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:25:49.616750    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ea1c9bb5-f909-446c-b067-d1dcf2507a25" path="/var/lib/kubelet/pods/ea1c9bb5-f909-446c-b067-d1dcf2507a25/volumes"
Oct 30 21:25:51.061762 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:25:51.061730    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:26:04.082150 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:04.082120    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:06.218502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:06.218465    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:09.720277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:09.720238    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:13.685238 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:13.685201    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:16.738979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:16.738938    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:19.742995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:19.742940    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:21.063873 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:26:21.063834    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:26:24.354282 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:24.354243    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:30.780363 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:30.780272    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:36.031017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:36.030976    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:39.304739 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:39.304704    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:44.906531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:44.906497    4943 generic.go:356] "Generic (PLEG): container finished" podID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerID="459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152" exitCode=1
Oct 30 21:26:44.906920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:44.906579    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" event={"ID":"8946ba66-fc18-4527-a27b-dd93cf55f850","Type":"ContainerDied","Data":"459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152"}
Oct 30 21:26:44.906920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:44.906907    4943 scope.go:122] "RemoveContainer" containerID="459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152"
Oct 30 21:26:45.678535 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:45.678501    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:26:45.684172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:45.684145    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:26:45.880755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:45.880729    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:26:46.924405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:46.924369    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" event={"ID":"8946ba66-fc18-4527-a27b-dd93cf55f850","Type":"ContainerStarted","Data":"9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d"}
Oct 30 21:26:46.924831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:46.924580    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:26:51.064882 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:26:51.064849    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:26:54.754720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:54.754629    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:54.993761 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:54.993721    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:26:57.932084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:26:57.932052    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 21:27:00.578522 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.578491    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"]
Oct 30 21:27:00.578943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.578927    4943 cpu_manager.go:414] "containerMap: removing container" podUID="ea1c9bb5-f909-446c-b067-d1dcf2507a25" containerName="manager"
Oct 30 21:27:00.578985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.578946    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ea1c9bb5-f909-446c-b067-d1dcf2507a25" containerName="manager"
Oct 30 21:27:00.579033 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.579022    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="ea1c9bb5-f909-446c-b067-d1dcf2507a25" containerName="manager"
Oct 30 21:27:00.582126 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.582107    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.627769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.627741    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.627894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.627788    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.627894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.627816    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.627980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.627913    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.627980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.627942    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4751d961-fd98-4419-9c0b-0bde40ffef5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.627980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.627965    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjb7l\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-kube-api-access-pjb7l\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.628103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.628002    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.628138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.628114    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.628170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.628144    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.690406 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.690377    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"]
Oct 30 21:27:00.729115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729080    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729248 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729206    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729248 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729226    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729367 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729263    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729367 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729289    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4751d961-fd98-4419-9c0b-0bde40ffef5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729420    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjb7l\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-kube-api-access-pjb7l\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729455    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729499    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729522    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729832 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729810    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.729899 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.729873    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.730066 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.730035    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.730305 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.730286    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.730392 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.730320    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4751d961-fd98-4419-9c0b-0bde40ffef5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.731763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.731745    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.732037 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.732020    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.785953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.785922    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.786675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.786654    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjb7l\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-kube-api-access-pjb7l\") pod \"maas-default-gateway-openshift-default-7f694df8bc-qg4kj\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:00.895123 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:00.895040    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:01.319442 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:01.319411    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"]
Oct 30 21:27:01.321900 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:27:01.321872    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4751d961_fd98_4419_9c0b_0bde40ffef5e.slice/crio-ee5b16ef7898d6e1f91e735c77c26a8c30ae28bd91980e7c6cb8d6ddc8ab1cfe WatchSource:0}: Error finding container ee5b16ef7898d6e1f91e735c77c26a8c30ae28bd91980e7c6cb8d6ddc8ab1cfe: Status 404 returned error can't find the container with id ee5b16ef7898d6e1f91e735c77c26a8c30ae28bd91980e7c6cb8d6ddc8ab1cfe
Oct 30 21:27:01.324055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:01.324021    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:01.324122 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:01.324107    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:01.324164 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:01.324141    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:02.003878 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:02.003844    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" event={"ID":"4751d961-fd98-4419-9c0b-0bde40ffef5e","Type":"ContainerStarted","Data":"55e4003f626146f6db857148fc669dc0f46405cbce2f3f04e4b9eda053ae758c"}
Oct 30 21:27:02.004335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:02.003891    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" event={"ID":"4751d961-fd98-4419-9c0b-0bde40ffef5e","Type":"ContainerStarted","Data":"ee5b16ef7898d6e1f91e735c77c26a8c30ae28bd91980e7c6cb8d6ddc8ab1cfe"}
Oct 30 21:27:02.128340 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:02.128283    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podStartSLOduration=2.128268167 podStartE2EDuration="2.128268167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:02.127636311 +0000 UTC m=+616.623209663" watchObservedRunningTime="2026-10-30 21:27:02.128268167 +0000 UTC m=+616.623841518"
Oct 30 21:27:02.896023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:02.895986    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:02.897409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:02.897385    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:27:02.897499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:02.897433    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 21:27:03.895991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:03.895951    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:27:03.896457 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:03.896430    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 21:27:04.896357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:04.896319    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:27:04.896842 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:04.896812    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 21:27:05.895812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:05.895761    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:27:05.895988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:05.895837    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 21:27:06.060578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.051480    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6896667454-bs2vb"]
Oct 30 21:27:06.070109 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.070075    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.097730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.097704    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5b263bc-c9d1-49f0-90af-cb59569ec928-tls-cert\") pod \"authorino-6896667454-bs2vb\" (UID: \"f5b263bc-c9d1-49f0-90af-cb59569ec928\") " pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.097861 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.097739    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvpz2\" (UniqueName: \"kubernetes.io/projected/f5b263bc-c9d1-49f0-90af-cb59569ec928-kube-api-access-tvpz2\") pod \"authorino-6896667454-bs2vb\" (UID: \"f5b263bc-c9d1-49f0-90af-cb59569ec928\") " pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.110032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.110000    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6896667454-bs2vb"]
Oct 30 21:27:06.199114 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.199072    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5b263bc-c9d1-49f0-90af-cb59569ec928-tls-cert\") pod \"authorino-6896667454-bs2vb\" (UID: \"f5b263bc-c9d1-49f0-90af-cb59569ec928\") " pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.199114 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.199117    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvpz2\" (UniqueName: \"kubernetes.io/projected/f5b263bc-c9d1-49f0-90af-cb59569ec928-kube-api-access-tvpz2\") pod \"authorino-6896667454-bs2vb\" (UID: \"f5b263bc-c9d1-49f0-90af-cb59569ec928\") " pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.201733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.201692    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f5b263bc-c9d1-49f0-90af-cb59569ec928-tls-cert\") pod \"authorino-6896667454-bs2vb\" (UID: \"f5b263bc-c9d1-49f0-90af-cb59569ec928\") " pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.270492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.270460    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvpz2\" (UniqueName: \"kubernetes.io/projected/f5b263bc-c9d1-49f0-90af-cb59569ec928-kube-api-access-tvpz2\") pod \"authorino-6896667454-bs2vb\" (UID: \"f5b263bc-c9d1-49f0-90af-cb59569ec928\") " pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.322117 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.322082    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:06.384127 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.383913    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6896667454-bs2vb"
Oct 30 21:27:06.568921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.568831    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:06.773271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.773203    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6896667454-bs2vb"]
Oct 30 21:27:06.781752 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:27:06.781725    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5b263bc_c9d1_49f0_90af_cb59569ec928.slice/crio-c8d14c9151032033b7af56978c3aae7308aa80b70cf3cdb595e701a3fea34f7a WatchSource:0}: Error finding container c8d14c9151032033b7af56978c3aae7308aa80b70cf3cdb595e701a3fea34f7a: Status 404 returned error can't find the container with id c8d14c9151032033b7af56978c3aae7308aa80b70cf3cdb595e701a3fea34f7a
Oct 30 21:27:06.783159 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.783135    4943 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:27:06.896266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.896172    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:27:06.896266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:06.896248    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 21:27:07.035352 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:07.035320    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6896667454-bs2vb" event={"ID":"f5b263bc-c9d1-49f0-90af-cb59569ec928","Type":"ContainerStarted","Data":"c8d14c9151032033b7af56978c3aae7308aa80b70cf3cdb595e701a3fea34f7a"}
Oct 30 21:27:07.895842 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:07.895806    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Oct 30 21:27:07.896315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:07.895870    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Oct 30 21:27:09.049099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.048997    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6896667454-bs2vb" event={"ID":"f5b263bc-c9d1-49f0-90af-cb59569ec928","Type":"ContainerStarted","Data":"4af6ddca4d323e7a8d5ad79b700242f532bad4d6305e65411872386c790cbb48"}
Oct 30 21:27:09.167080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.167018    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6896667454-bs2vb" podStartSLOduration=1.288712282 podStartE2EDuration="3.167003618s" totalImagesPullingTime="1.878291336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:09.165116547 +0000 UTC m=+623.660689899" watchObservedRunningTime="2026-10-30 21:27:09.167003618 +0000 UTC m=+623.662576969"
Oct 30 21:27:09.219881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.219820    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76d6c4d689-p6vdg"]
Oct 30 21:27:09.221801 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.221761    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-76d6c4d689-p6vdg" podUID="8c90a860-0776-452e-9964-4ada9cf28c53" containerName="authorino" containerID="cri-o://79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3" gracePeriod=30
Oct 30 21:27:09.567484 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.567194    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:27:09.646627 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.644838    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8c90a860-0776-452e-9964-4ada9cf28c53-tls-cert\" (UniqueName: \"kubernetes.io/secret/8c90a860-0776-452e-9964-4ada9cf28c53-tls-cert\") pod \"8c90a860-0776-452e-9964-4ada9cf28c53\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") "
Oct 30 21:27:09.646627 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.644989    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c90a860-0776-452e-9964-4ada9cf28c53-kube-api-access-bt97h\" (UniqueName: \"kubernetes.io/projected/8c90a860-0776-452e-9964-4ada9cf28c53-kube-api-access-bt97h\") pod \"8c90a860-0776-452e-9964-4ada9cf28c53\" (UID: \"8c90a860-0776-452e-9964-4ada9cf28c53\") "
Oct 30 21:27:09.649300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.649214    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c90a860-0776-452e-9964-4ada9cf28c53-kube-api-access-bt97h" pod "8c90a860-0776-452e-9964-4ada9cf28c53" (UID: "8c90a860-0776-452e-9964-4ada9cf28c53"). InnerVolumeSpecName "kube-api-access-bt97h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:27:09.661084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.661051    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c90a860-0776-452e-9964-4ada9cf28c53-tls-cert" pod "8c90a860-0776-452e-9964-4ada9cf28c53" (UID: "8c90a860-0776-452e-9964-4ada9cf28c53"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:27:09.745951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.745884    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt97h\" (UniqueName: \"kubernetes.io/projected/8c90a860-0776-452e-9964-4ada9cf28c53-kube-api-access-bt97h\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.745951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.745923    4943 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c90a860-0776-452e-9964-4ada9cf28c53-tls-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:27:09.937766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.937718    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:27:09.937947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:09.937814    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:27:10.074811 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.074771    4943 generic.go:356] "Generic (PLEG): container finished" podID="8c90a860-0776-452e-9964-4ada9cf28c53" containerID="79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3" exitCode=0
Oct 30 21:27:10.075594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.075570    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76d6c4d689-p6vdg"
Oct 30 21:27:10.078909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.076633    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d6c4d689-p6vdg" event={"ID":"8c90a860-0776-452e-9964-4ada9cf28c53","Type":"ContainerDied","Data":"79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3"}
Oct 30 21:27:10.078909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.076683    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76d6c4d689-p6vdg" event={"ID":"8c90a860-0776-452e-9964-4ada9cf28c53","Type":"ContainerDied","Data":"7203f3e46ead9db5b009abffa78056b79ec1a9f299919d0502473f3591a3dac6"}
Oct 30 21:27:10.078909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.076706    4943 scope.go:122] "RemoveContainer" containerID="79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3"
Oct 30 21:27:10.094967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.094923    4943 scope.go:122] "RemoveContainer" containerID="79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3"
Oct 30 21:27:10.095318 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:27:10.095288    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3\": container with ID starting with 79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3 not found: ID does not exist" containerID="79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3"
Oct 30 21:27:10.095409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.095328    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3"} err="failed to get container status \"79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3\": rpc error: code = NotFound desc = could not find container \"79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3\": container with ID starting with 79a07e09a68bac1ce8267bb3d924a718a7c120e8f3494fc01284f27ffcd766e3 not found: ID does not exist"
Oct 30 21:27:10.245969 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.245868    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76d6c4d689-p6vdg"]
Oct 30 21:27:10.249763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.249734    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76d6c4d689-p6vdg"]
Oct 30 21:27:10.938875 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.938827    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:27:10.939060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:10.938901    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:27:11.618472 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:11.618434    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c90a860-0776-452e-9964-4ada9cf28c53" path="/var/lib/kubelet/pods/8c90a860-0776-452e-9964-4ada9cf28c53/volumes"
Oct 30 21:27:11.980765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:11.980726    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-qg4kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:27:11.981080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:11.981028    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:27:12.523004 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:12.522969    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:12.523819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:12.523795    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:12.525137 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:12.525118    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:27:20.021931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:20.021894    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:21.062905 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:27:21.062870    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:27:27.402831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:27.402782    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:27.576226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:27.576193    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:30.830277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.830237    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"]
Oct 30 21:27:30.830892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.830808    4943 cpu_manager.go:414] "containerMap: removing container" podUID="8c90a860-0776-452e-9964-4ada9cf28c53" containerName="authorino"
Oct 30 21:27:30.830892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.830827    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c90a860-0776-452e-9964-4ada9cf28c53" containerName="authorino"
Oct 30 21:27:30.831019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.830969    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c90a860-0776-452e-9964-4ada9cf28c53" containerName="authorino"
Oct 30 21:27:30.834024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.834003    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.938779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.938747    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.938911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.938799    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.938911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.938827    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.938988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.938940    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.939030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.938997    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.939100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.939073    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.939143 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.939127    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.939178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.939162    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:30.939211 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:30.939179    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crxqm\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-kube-api-access-crxqm\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040070    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"]
Oct 30 21:27:31.040408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040383    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040421    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040443    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040494    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040517    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040567    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040605    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040631    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crxqm\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-kube-api-access-crxqm\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040695    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.040993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.040919    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.041082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.041056    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.041323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.041299    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.041403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.041352    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.041538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.041518    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.042821 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.042801    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.045848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.045822    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.098278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.098203    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.098436 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.098402    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crxqm\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-kube-api-access-crxqm\") pod \"maas-default-gateway-openshift-default-7f694df8bc-v8hp6\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.146321 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.146288    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:31.573614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.573592    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"]
Oct 30 21:27:31.576055 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:27:31.576025    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83afdef1_0d60_4f13_bce4_7bc2b09bddf4.slice/crio-867da67ceaf5663753f60f5433f643bf2785eedad3de8623ebd63f44c062df2f WatchSource:0}: Error finding container 867da67ceaf5663753f60f5433f643bf2785eedad3de8623ebd63f44c062df2f: Status 404 returned error can't find the container with id 867da67ceaf5663753f60f5433f643bf2785eedad3de8623ebd63f44c062df2f
Oct 30 21:27:31.578347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.578317    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:31.578431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.578380    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:31.578431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:31.578408    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:27:32.198295 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:32.198253    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" event={"ID":"83afdef1-0d60-4f13-bce4-7bc2b09bddf4","Type":"ContainerStarted","Data":"e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe"}
Oct 30 21:27:32.198793 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:32.198341    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" event={"ID":"83afdef1-0d60-4f13-bce4-7bc2b09bddf4","Type":"ContainerStarted","Data":"867da67ceaf5663753f60f5433f643bf2785eedad3de8623ebd63f44c062df2f"}
Oct 30 21:27:32.324659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:32.324598    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podStartSLOduration=2.324577437 podStartE2EDuration="2.324577437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:27:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:27:32.322120045 +0000 UTC m=+646.817693397" watchObservedRunningTime="2026-10-30 21:27:32.324577437 +0000 UTC m=+646.820150787"
Oct 30 21:27:33.164592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:33.154902    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:33.167705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:33.167676    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:27:33.167857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:33.167733    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 21:27:34.153585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:34.152922    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:27:34.153585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:34.152997    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 21:27:35.164579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:35.153913    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:27:35.164579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:35.153973    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 21:27:36.152933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:36.152897    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:27:36.153194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:36.153163    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 21:27:37.158579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:37.152931    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:27:37.158579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:37.153008    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 21:27:38.146885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:38.146839    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-v8hp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Oct 30 21:27:38.147056 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:38.146920    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Oct 30 21:27:39.644920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:39.644880    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:39.913901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:39.913867    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:39.914265 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:39.914241    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:39.915048 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:39.915028    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:27:46.712700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:46.712669    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:47.218543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:47.218513    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:48.773344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:48.773307    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:48.968276 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:48.968229    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:50.342317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:50.342268    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:50.634498 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:27:50.634426    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:27:51.062268 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:27:51.062234    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:28:21.061508 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:28:21.061473    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:28:39.972865 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:39.972829    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:47.344621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:47.344588    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:47.526781 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:47.526749    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:47.975526 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:47.975464    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:48.222590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:48.222534    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:48.402456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:48.402428    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:48.592047 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:48.592009    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:48.784422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:48.784341    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:48.960706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:48.960669    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:49.156029 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:49.155979    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:49.345909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:49.345873    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:49.536770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:49.536680    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:51.062272 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:28:51.062230    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:28:52.204783 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:52.204750    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:52.424354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:52.424326    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:52.835397 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:52.835360    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:53.047235 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:53.047198    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:53.528155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:53.528125    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:53.736944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:53.736911    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:54.246778 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:54.246744    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:54.468155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:54.468112    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:54.718917 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:54.718885    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:54.945123 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:54.945091    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:56.898438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:56.898406    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:57.085232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:57.085197    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:57.334703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:57.334620    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:57.900735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:57.900699    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:58.093488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.093453    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:58.102154 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.102119    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"]
Oct 30 21:28:58.106656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.106637    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.188540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.188450    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"]
Oct 30 21:28:58.210284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.210257    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-89c0fd-openshift-default-dockercfg-kzh9g\""
Oct 30 21:28:58.234246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234211    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234537 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234509    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234581    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234608    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234658    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234710    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234753    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234783    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6xzb\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-kube-api-access-t6xzb\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.234854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.234826    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.277817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.277781    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:58.336212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336171    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336266    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336320    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336360    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336386    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336433    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336550    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336634    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336665    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6xzb\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-kube-api-access-t6xzb\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.336904 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336869    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.337014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.336992    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.337178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.337156    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.337252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.337193    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.337498 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.337475    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.338898 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.338877    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.339158 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.339143    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.394763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.394735    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.394960 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.394935    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6xzb\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-kube-api-access-t6xzb\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.423437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.423411    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:28:58.526103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.526067    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:58.707403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.707368    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:58.862207 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.862185    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"]
Oct 30 21:28:58.863976 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:28:58.863948    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2d8b99_00c6_49f4_b48d_ed5fffb21809.slice/crio-804acb3286dfb40639b915050597c86b2b3d0ebae0baf0a2b4f857a767420c14 WatchSource:0}: Error finding container 804acb3286dfb40639b915050597c86b2b3d0ebae0baf0a2b4f857a767420c14: Status 404 returned error can't find the container with id 804acb3286dfb40639b915050597c86b2b3d0ebae0baf0a2b4f857a767420c14
Oct 30 21:28:58.866181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.866150    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:28:58.866270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.866210    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:28:58.866270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.866237    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:28:58.887914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:58.887892    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:28:59.669101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:59.669050    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" event={"ID":"af2d8b99-00c6-49f4-b48d-ed5fffb21809","Type":"ContainerStarted","Data":"56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b"}
Oct 30 21:28:59.669487 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:59.669116    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" event={"ID":"af2d8b99-00c6-49f4-b48d-ed5fffb21809","Type":"ContainerStarted","Data":"804acb3286dfb40639b915050597c86b2b3d0ebae0baf0a2b4f857a767420c14"}
Oct 30 21:28:59.785325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:28:59.785265    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podStartSLOduration=1.785247029 podStartE2EDuration="1.785247029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:28:59.784083232 +0000 UTC m=+734.279656595" watchObservedRunningTime="2026-10-30 21:28:59.785247029 +0000 UTC m=+734.280820380"
Oct 30 21:29:00.424471 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:00.424436    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:29:00.429675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:00.429649    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:29:00.674896 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:00.674817    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:29:00.675779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:00.675761    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:29:01.726216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:01.726181    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:01.905902 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:01.905859    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:03.791178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:03.791138    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:03.960025 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:03.959975    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:04.193090 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:04.193055    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:04.366272 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:04.366239    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:06.468435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:06.468396    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:06.668316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:06.668265    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:06.850748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:06.850645    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:07.031320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:07.031275    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:09.049138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:09.049100    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:09.216144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:09.216112    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:09.389226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:09.389128    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:11.556024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:11.555986    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:11.732465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:11.732420    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:13.229892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:13.229844    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:13.430449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:13.430411    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:13.613521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:13.613409    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:14.008271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.008235    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"]
Oct 30 21:29:14.011984 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.011966    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.066614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.066587    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 21:29:14.116154 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.116126    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 30 21:29:14.116154 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.116146    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-446ca2-serving-cert\""
Oct 30 21:29:14.116402 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.116187    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 21:29:14.116402 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.116221    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-bk7w4\""
Oct 30 21:29:14.118940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.118916    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"]
Oct 30 21:29:14.198166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.198129    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.198316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.198199    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr4r4\" (UniqueName: \"kubernetes.io/projected/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-kube-api-access-fr4r4\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.198316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.198299    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.198389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.198366    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-metrics-certs\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.265500 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.265383    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:14.299778 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.299743    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-metrics-certs\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.299963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.299799    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.299963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.299878    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr4r4\" (UniqueName: \"kubernetes.io/projected/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-kube-api-access-fr4r4\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.299963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.299929    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.300094 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:14.300063    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-serving-cert: secret "maas-api-e2e-worker-w2-446ca2-serving-cert" not found
Oct 30 21:29:14.300157 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:14.300143    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls podName:2d4b97c7-2e09-42a1-b01a-a739c91c36dc nodeName:}" failed. No retries permitted until 2026-10-30 21:29:14.800121927 +0000 UTC m=+749.295695257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls") pod "maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf" (UID: "2d4b97c7-2e09-42a1-b01a-a739c91c36dc") : secret "maas-api-e2e-worker-w2-446ca2-serving-cert" not found
Oct 30 21:29:14.300642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.300619    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.302407 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.302380    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-metrics-certs\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.361595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.361545    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr4r4\" (UniqueName: \"kubernetes.io/projected/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-kube-api-access-fr4r4\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.451819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.451786    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:14.646814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.646743    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:14.804260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.804224    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.806727 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.806700    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls\") pod \"maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:14.925542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:14.925508    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:15.303925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:15.303900    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"]
Oct 30 21:29:15.306354 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:29:15.306319    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4b97c7_2e09_42a1_b01a_a739c91c36dc.slice/crio-e5c32864ec79e347de84c2ac0de363e37f4ebd359a8001ecf710d654c6cb10da WatchSource:0}: Error finding container e5c32864ec79e347de84c2ac0de363e37f4ebd359a8001ecf710d654c6cb10da: Status 404 returned error can't find the container with id e5c32864ec79e347de84c2ac0de363e37f4ebd359a8001ecf710d654c6cb10da
Oct 30 21:29:15.763040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:15.763003    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf" event={"ID":"2d4b97c7-2e09-42a1-b01a-a739c91c36dc","Type":"ContainerStarted","Data":"e5c32864ec79e347de84c2ac0de363e37f4ebd359a8001ecf710d654c6cb10da"}
Oct 30 21:29:17.779215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:17.779179    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf" event={"ID":"2d4b97c7-2e09-42a1-b01a-a739c91c36dc","Type":"ContainerStarted","Data":"834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487"}
Oct 30 21:29:17.779738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:17.779365    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:17.896954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:17.896901    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf" podStartSLOduration=3.064103285 podStartE2EDuration="4.896881868s" totalImagesPullingTime="1.832778583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:17.89371282 +0000 UTC m=+752.389286171" watchObservedRunningTime="2026-10-30 21:29:17.896881868 +0000 UTC m=+752.392455219"
Oct 30 21:29:18.617786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:18.617755    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:18.792636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:18.792600    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:19.778343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:19.778306    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:21.062992 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:21.062956    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:29:23.380170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:23.380073    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:23.575732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:23.575695    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:23.792017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:23.791985    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 21:29:24.503430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.503390    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"]
Oct 30 21:29:24.507253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.507229    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.564131 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.564100    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"]
Oct 30 21:29:24.593540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.593505    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.593685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.593617    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-metrics-certs\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.593685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.593669    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf69444-5ab3-4471-8eaf-5479d9b852d8-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.593793 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.593709    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4l54\" (UniqueName: \"kubernetes.io/projected/2cf69444-5ab3-4471-8eaf-5479d9b852d8-kube-api-access-v4l54\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.610313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.610288    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-021907-serving-cert\""
Oct 30 21:29:24.694905 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.694883    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.695031 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.694928    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-metrics-certs\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.695031 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.694962    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf69444-5ab3-4471-8eaf-5479d9b852d8-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.695031 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.694994    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4l54\" (UniqueName: \"kubernetes.io/projected/2cf69444-5ab3-4471-8eaf-5479d9b852d8-kube-api-access-v4l54\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.695176 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:24.695028    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-serving-cert: secret "maas-api-e2e-worker-w5-021907-serving-cert" not found
Oct 30 21:29:24.695176 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:24.695080    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls podName:2cf69444-5ab3-4471-8eaf-5479d9b852d8 nodeName:}" failed. No retries permitted until 2026-10-30 21:29:25.195064908 +0000 UTC m=+759.690638252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls") pod "maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw" (UID: "2cf69444-5ab3-4471-8eaf-5479d9b852d8") : secret "maas-api-e2e-worker-w5-021907-serving-cert" not found
Oct 30 21:29:24.695735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.695714    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf69444-5ab3-4471-8eaf-5479d9b852d8-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.697322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.697302    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-metrics-certs\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.752520 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.752488    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4l54\" (UniqueName: \"kubernetes.io/projected/2cf69444-5ab3-4471-8eaf-5479d9b852d8-kube-api-access-v4l54\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:24.828996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:24.828846    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:25.027769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:25.027736    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:25.198956 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:25.198921    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:25.201505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:25.201475    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls\") pod \"maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:25.214672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:25.214644    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:25.420780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:25.420740    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:25.801677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:25.801653    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"]
Oct 30 21:29:25.803700 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:29:25.803671    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf69444_5ab3_4471_8eaf_5479d9b852d8.slice/crio-a953794910cb5da97c55b971feea87f7a5bdf265718b386875ad5f22bcc5f790 WatchSource:0}: Error finding container a953794910cb5da97c55b971feea87f7a5bdf265718b386875ad5f22bcc5f790: Status 404 returned error can't find the container with id a953794910cb5da97c55b971feea87f7a5bdf265718b386875ad5f22bcc5f790
Oct 30 21:29:25.838611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:25.838582    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw" event={"ID":"2cf69444-5ab3-4471-8eaf-5479d9b852d8","Type":"ContainerStarted","Data":"a953794910cb5da97c55b971feea87f7a5bdf265718b386875ad5f22bcc5f790"}
Oct 30 21:29:26.845365 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:26.845331    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw" event={"ID":"2cf69444-5ab3-4471-8eaf-5479d9b852d8","Type":"ContainerStarted","Data":"a3e21a49d96d4aff1da6612119cad2a70464ef8b02c404a166c95712a5c3095e"}
Oct 30 21:29:26.845759 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:26.845513    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:26.989296 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:26.989199    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw" podStartSLOduration=2.105318765 podStartE2EDuration="2.989187263s" totalImagesPullingTime="883.868498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:26.988741224 +0000 UTC m=+761.484314576" watchObservedRunningTime="2026-10-30 21:29:26.989187263 +0000 UTC m=+761.484760614"
Oct 30 21:29:30.117739 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:30.117699    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:32.855665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:32.855634    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:29:35.106906 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:35.106784    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:35.331010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:35.330961    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:35.597127 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:35.597098    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:37.887341 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:37.887305    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:38.447840 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:38.447804    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:38.627189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:38.627111    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:40.307698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:40.307664    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:40.499962 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:40.499926    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:42.786375 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:42.786346    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:45.669935 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:45.669901    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:48.237369 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:48.237329    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:48.889420 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:48.889350    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:49.095876 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:49.095843    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:50.545267 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.545229    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"]
Oct 30 21:29:50.549286 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.549268    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.640143 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.640103    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.640313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.640162    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.640362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.640299    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zcz8\" (UniqueName: \"kubernetes.io/projected/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-kube-api-access-4zcz8\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.640409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.640355    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-metrics-certs\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.651909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.651884    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-1b5b5f-serving-cert\""
Oct 30 21:29:50.656030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.656003    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"]
Oct 30 21:29:50.741197 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.741154    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.741389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.741209    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.741389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.741261    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zcz8\" (UniqueName: \"kubernetes.io/projected/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-kube-api-access-4zcz8\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.741389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.741300    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-metrics-certs\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.741389 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:50.741315    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-serving-cert: secret "maas-api-e2e-worker-w0-1b5b5f-serving-cert" not found
Oct 30 21:29:50.741389 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:50.741385    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls podName:4ea37082-158c-4bcb-b9b1-68ab1ee522aa nodeName:}" failed. No retries permitted until 2026-10-30 21:29:51.241362542 +0000 UTC m=+785.736935890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls") pod "maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7" (UID: "4ea37082-158c-4bcb-b9b1-68ab1ee522aa") : secret "maas-api-e2e-worker-w0-1b5b5f-serving-cert" not found
Oct 30 21:29:50.742020 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.741993    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.744114 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.744089    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-metrics-certs\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.789321 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.789263    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:50.801453 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.801381    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zcz8\" (UniqueName: \"kubernetes.io/projected/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-kube-api-access-4zcz8\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:50.992367 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:50.991953    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:51.069694 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:29:51.069612    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:29:51.162015 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:51.161978    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:51.247836 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:51.247801    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:51.250632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:51.250608    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls\") pod \"maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:51.472770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:51.472728    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:51.852543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:51.852399    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"]
Oct 30 21:29:51.860445 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:29:51.860400    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea37082_158c_4bcb_b9b1_68ab1ee522aa.slice/crio-c268a70c4f7895652c9b9f5a46c42ad1749a74a80ea2c4140efea227d826d0e4 WatchSource:0}: Error finding container c268a70c4f7895652c9b9f5a46c42ad1749a74a80ea2c4140efea227d826d0e4: Status 404 returned error can't find the container with id c268a70c4f7895652c9b9f5a46c42ad1749a74a80ea2c4140efea227d826d0e4
Oct 30 21:29:52.017985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:52.017940    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7" event={"ID":"4ea37082-158c-4bcb-b9b1-68ab1ee522aa","Type":"ContainerStarted","Data":"c268a70c4f7895652c9b9f5a46c42ad1749a74a80ea2c4140efea227d826d0e4"}
Oct 30 21:29:53.026421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.026317    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7" event={"ID":"4ea37082-158c-4bcb-b9b1-68ab1ee522aa","Type":"ContainerStarted","Data":"8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002"}
Oct 30 21:29:53.026954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.026425    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:53.029465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.029430    4943 generic.go:356] "Generic (PLEG): container finished" podID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerID="56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b" exitCode=0
Oct 30 21:29:53.029645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.029540    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" event={"ID":"af2d8b99-00c6-49f4-b48d-ed5fffb21809","Type":"ContainerDied","Data":"56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b"}
Oct 30 21:29:53.029957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.029937    4943 scope.go:122] "RemoveContainer" containerID="56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b"
Oct 30 21:29:53.031495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.031461    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:29:53.031647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.031588    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:29:53.031647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.031638    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:29:53.140991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:53.140938    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7" podStartSLOduration=2.2718819 podStartE2EDuration="3.14092228s" totalImagesPullingTime="869.04038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:29:53.138884001 +0000 UTC m=+787.634457347" watchObservedRunningTime="2026-10-30 21:29:53.14092228 +0000 UTC m=+787.636495632"
Oct 30 21:29:54.037695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:54.037657    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" event={"ID":"af2d8b99-00c6-49f4-b48d-ed5fffb21809","Type":"ContainerStarted","Data":"5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a"}
Oct 30 21:29:54.424148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:54.424114    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:29:54.424315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:54.424270    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:29:54.424366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:54.424323    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 21:29:55.424828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:55.424796    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:29:55.425243 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:55.424854    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 21:29:56.274834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:56.274787    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:56.424620 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:56.424579    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:29:56.424821 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:56.424649    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 21:29:57.426738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:57.426704    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:29:57.427181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:57.426774    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 21:29:58.410881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:58.410847    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:29:58.424041 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:58.424005    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Oct 30 21:29:58.424182 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:58.424062    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Oct 30 21:29:59.043845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:59.043815    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:29:59.427437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:59.427409    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:29:59.427827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:59.427806    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:29:59.428472 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:29:59.428456    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:30:00.172526 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.172490    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"]
Oct 30 21:30:00.177910 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.177888    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.194027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.194001    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"]
Oct 30 21:30:00.197423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.197405    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.207777 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.207752    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"]
Oct 30 21:30:00.211759 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.211739    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.229049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.229033    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6t2c7\""
Oct 30 21:30:00.236539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.236521    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tkwl\" (UniqueName: \"kubernetes.io/projected/3854a067-b3a5-436f-acd3-5d2fadf93672-kube-api-access-2tkwl\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.236615 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.236589    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3854a067-b3a5-436f-acd3-5d2fadf93672-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.236652 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.236642    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.236742 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.236724    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dlx9\" (UniqueName: \"kubernetes.io/projected/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-kube-api-access-7dlx9\") pod \"maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.274493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.274457    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"]
Oct 30 21:30:00.274699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.274533    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"]
Oct 30 21:30:00.315871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.315837    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"]
Oct 30 21:30:00.337387 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.337359    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tkwl\" (UniqueName: \"kubernetes.io/projected/3854a067-b3a5-436f-acd3-5d2fadf93672-kube-api-access-2tkwl\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.337542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.337404    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3854a067-b3a5-436f-acd3-5d2fadf93672-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.337542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.337425    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.337542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.337459    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.337542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.337483    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dlx9\" (UniqueName: \"kubernetes.io/projected/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-kube-api-access-7dlx9\") pod \"maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.337542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.337512    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k84k6\" (UniqueName: \"kubernetes.io/projected/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-kube-api-access-k84k6\") pod \"maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.338161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.338134    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.338251 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.338144    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3854a067-b3a5-436f-acd3-5d2fadf93672-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.398309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.398270    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dlx9\" (UniqueName: \"kubernetes.io/projected/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-kube-api-access-7dlx9\") pod \"maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.398445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.398334    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tkwl\" (UniqueName: \"kubernetes.io/projected/3854a067-b3a5-436f-acd3-5d2fadf93672-kube-api-access-2tkwl\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.438718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.438649    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k84k6\" (UniqueName: \"kubernetes.io/projected/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-kube-api-access-k84k6\") pod \"maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.438843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.438808    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.439380 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.439361    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.491190 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.491162    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:00.494679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.494648    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k84k6\" (UniqueName: \"kubernetes.io/projected/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-kube-api-access-k84k6\") pod \"maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.512999 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.512970    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:00.524153 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.524129    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:00.885638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.884940    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"]
Oct 30 21:30:00.887525 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:30:00.887477    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3854a067_b3a5_436f_acd3_5d2fadf93672.slice/crio-0a862c5be4e7c738c3909e1415f3e2afa179b6058d1edef5abdfc752bdee5d74 WatchSource:0}: Error finding container 0a862c5be4e7c738c3909e1415f3e2afa179b6058d1edef5abdfc752bdee5d74: Status 404 returned error can't find the container with id 0a862c5be4e7c738c3909e1415f3e2afa179b6058d1edef5abdfc752bdee5d74
Oct 30 21:30:00.927871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.927844    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"]
Oct 30 21:30:00.929318 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:30:00.929293    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8490e1_b77d_45eb_9aad_b1bc2c40c3e5.slice/crio-1051e99f1269291f31199318757dd895f4101977c33329cdf664f009cde19bd5 WatchSource:0}: Error finding container 1051e99f1269291f31199318757dd895f4101977c33329cdf664f009cde19bd5: Status 404 returned error can't find the container with id 1051e99f1269291f31199318757dd895f4101977c33329cdf664f009cde19bd5
Oct 30 21:30:00.931711 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:30:00.931342    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe8804a_4cb9_4964_8ce0_b9cda1c6d85b.slice/crio-7b7fcd28ee80964deb05a41d2f8c4a559ce1eb99fab52c4c695dfdc9d292c947 WatchSource:0}: Error finding container 7b7fcd28ee80964deb05a41d2f8c4a559ce1eb99fab52c4c695dfdc9d292c947: Status 404 returned error can't find the container with id 7b7fcd28ee80964deb05a41d2f8c4a559ce1eb99fab52c4c695dfdc9d292c947
Oct 30 21:30:00.931988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:00.931960    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"]
Oct 30 21:30:01.101799 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:01.101746    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" event={"ID":"3854a067-b3a5-436f-acd3-5d2fadf93672","Type":"ContainerStarted","Data":"0a862c5be4e7c738c3909e1415f3e2afa179b6058d1edef5abdfc752bdee5d74"}
Oct 30 21:30:01.103954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:01.103917    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" event={"ID":"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b","Type":"ContainerStarted","Data":"7b7fcd28ee80964deb05a41d2f8c4a559ce1eb99fab52c4c695dfdc9d292c947"}
Oct 30 21:30:01.105359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:01.105329    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" event={"ID":"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5","Type":"ContainerStarted","Data":"1051e99f1269291f31199318757dd895f4101977c33329cdf664f009cde19bd5"}
Oct 30 21:30:01.360253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:01.360197    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:01.541035 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:01.541003    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:03.929605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:03.929493    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:04.493702 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:04.493643    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:04.684325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:04.684289    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:04.889666 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:04.889519    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:05.137433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:05.137396    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:06.143576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:06.142706    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" event={"ID":"3854a067-b3a5-436f-acd3-5d2fadf93672","Type":"ContainerStarted","Data":"cba2edd8fd7144e3a8558ae41ba3878f928b8df7019b44fe631111324e4d4b85"}
Oct 30 21:30:06.144469 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:06.144440    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" event={"ID":"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5","Type":"ContainerStarted","Data":"77db77d05c3ccd133c4544ae4835ee2ff98d4ac7adb4f33c74f527bbb1dd25fe"}
Oct 30 21:30:06.266366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:06.266321    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" podStartSLOduration=1.489178189 podStartE2EDuration="6.266307949s" totalImagesPullingTime="4.77712976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:06.264314695 +0000 UTC m=+800.759888072" watchObservedRunningTime="2026-10-30 21:30:06.266307949 +0000 UTC m=+800.761881300"
Oct 30 21:30:06.391464 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:06.391407    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" podStartSLOduration=2.002598785 podStartE2EDuration="6.391391863s" totalImagesPullingTime="4.388793078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:06.38909364 +0000 UTC m=+800.884666991" watchObservedRunningTime="2026-10-30 21:30:06.391391863 +0000 UTC m=+800.886965211"
Oct 30 21:30:06.637218 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:06.637134    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:06.833151 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:06.833117    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:07.151392 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.151352    4943 generic.go:356] "Generic (PLEG): container finished" podID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerID="77db77d05c3ccd133c4544ae4835ee2ff98d4ac7adb4f33c74f527bbb1dd25fe" exitCode=60
Oct 30 21:30:07.151866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.151436    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" event={"ID":"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5","Type":"ContainerDied","Data":"77db77d05c3ccd133c4544ae4835ee2ff98d4ac7adb4f33c74f527bbb1dd25fe"}
Oct 30 21:30:07.151866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.151702    4943 scope.go:122] "RemoveContainer" containerID="77db77d05c3ccd133c4544ae4835ee2ff98d4ac7adb4f33c74f527bbb1dd25fe"
Oct 30 21:30:07.153503 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.153274    4943 generic.go:356] "Generic (PLEG): container finished" podID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerID="cba2edd8fd7144e3a8558ae41ba3878f928b8df7019b44fe631111324e4d4b85" exitCode=60
Oct 30 21:30:07.153503 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.153367    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" event={"ID":"3854a067-b3a5-436f-acd3-5d2fadf93672","Type":"ContainerDied","Data":"cba2edd8fd7144e3a8558ae41ba3878f928b8df7019b44fe631111324e4d4b85"}
Oct 30 21:30:07.153752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.153594    4943 scope.go:122] "RemoveContainer" containerID="cba2edd8fd7144e3a8558ae41ba3878f928b8df7019b44fe631111324e4d4b85"
Oct 30 21:30:07.157674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.157591    4943 generic.go:356] "Generic (PLEG): container finished" podID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerID="03e69d42dfcf877bd64ae437d6d0810d97aa2a2ec77c16bb80018463e458b613" exitCode=60
Oct 30 21:30:07.157674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.157621    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" event={"ID":"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b","Type":"ContainerDied","Data":"03e69d42dfcf877bd64ae437d6d0810d97aa2a2ec77c16bb80018463e458b613"}
Oct 30 21:30:07.157850 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.157833    4943 scope.go:122] "RemoveContainer" containerID="03e69d42dfcf877bd64ae437d6d0810d97aa2a2ec77c16bb80018463e458b613"
Oct 30 21:30:07.384199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.384153    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"]
Oct 30 21:30:07.387975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.387953    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.448833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.447650    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"]
Oct 30 21:30:07.448833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.447991    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-e4dadd\"/\"simulator-w1-e4dadd-kserve-self-signed-certs\""
Oct 30 21:30:07.448833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.448118    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-e4dadd\"/\"default-dockercfg-45994\""
Oct 30 21:30:07.448833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.448231    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-e4dadd\"/\"openshift-service-ca.crt\""
Oct 30 21:30:07.448833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.448291    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-e4dadd\"/\"kube-root-ca.crt\""
Oct 30 21:30:07.518644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.518573    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:07.523607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.523545    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-tmp-dir\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.523761 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.523658    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-model-cache\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.523761 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.523687    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74616002-631e-4d11-b33a-d970a68724f9-tls-certs\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.523860 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.523775    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-home\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.523860 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.523802    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-dshm\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.524038 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.523890    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9lm4\" (UniqueName: \"kubernetes.io/projected/74616002-631e-4d11-b33a-d970a68724f9-kube-api-access-j9lm4\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.624920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.624888    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74616002-631e-4d11-b33a-d970a68724f9-tls-certs\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.624942    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-home\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.624975    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-dshm\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.625022    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9lm4\" (UniqueName: \"kubernetes.io/projected/74616002-631e-4d11-b33a-d970a68724f9-kube-api-access-j9lm4\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625256 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.625163    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-tmp-dir\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625256 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.625201    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-model-cache\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.625425    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-home\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625519 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.625493    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-tmp-dir\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.625586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.625520    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-model-cache\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.627293 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.627262    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-dshm\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.627527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.627504    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74616002-631e-4d11-b33a-d970a68724f9-tls-certs\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.683147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.683111    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9lm4\" (UniqueName: \"kubernetes.io/projected/74616002-631e-4d11-b33a-d970a68724f9-kube-api-access-j9lm4\") pod \"simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") " pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:07.706427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:07.706352    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:08.102742 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.102710    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"]
Oct 30 21:30:08.115495 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:30:08.115459    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74616002_631e_4d11_b33a_d970a68724f9.slice/crio-1d2e71e57a9b7206e557240b2ccb4179c87a6a1488566231288f8e3d16df223e WatchSource:0}: Error finding container 1d2e71e57a9b7206e557240b2ccb4179c87a6a1488566231288f8e3d16df223e: Status 404 returned error can't find the container with id 1d2e71e57a9b7206e557240b2ccb4179c87a6a1488566231288f8e3d16df223e
Oct 30 21:30:08.165810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.165774    4943 generic.go:356] "Generic (PLEG): container finished" podID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerID="87646f3d3eac843261ccb8b5b8612a80ab2a463b7e96d1a4096296d98ad0318e" exitCode=60
Oct 30 21:30:08.166192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.165847    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" event={"ID":"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5","Type":"ContainerDied","Data":"87646f3d3eac843261ccb8b5b8612a80ab2a463b7e96d1a4096296d98ad0318e"}
Oct 30 21:30:08.166192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.165966    4943 scope.go:122] "RemoveContainer" containerID="77db77d05c3ccd133c4544ae4835ee2ff98d4ac7adb4f33c74f527bbb1dd25fe"
Oct 30 21:30:08.166192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.166070    4943 scope.go:122] "RemoveContainer" containerID="87646f3d3eac843261ccb8b5b8612a80ab2a463b7e96d1a4096296d98ad0318e"
Oct 30 21:30:08.166362 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:08.166343    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg_odh-ai-gateway-infra(be8490e1-b77d-45eb-9aad-b1bc2c40c3e5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5"
Oct 30 21:30:08.168407 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.168387    4943 generic.go:356] "Generic (PLEG): container finished" podID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerID="656ae3af080778dc5c75931c9b6b81428fd7dae6d4a5103202bb3046ac0a4f0e" exitCode=60
Oct 30 21:30:08.168485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.168412    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" event={"ID":"3854a067-b3a5-436f-acd3-5d2fadf93672","Type":"ContainerDied","Data":"656ae3af080778dc5c75931c9b6b81428fd7dae6d4a5103202bb3046ac0a4f0e"}
Oct 30 21:30:08.168719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.168700    4943 scope.go:122] "RemoveContainer" containerID="656ae3af080778dc5c75931c9b6b81428fd7dae6d4a5103202bb3046ac0a4f0e"
Oct 30 21:30:08.169022 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:08.168997    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj_odh-ai-gateway-infra(3854a067-b3a5-436f-acd3-5d2fadf93672)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672"
Oct 30 21:30:08.170353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.170332    4943 generic.go:356] "Generic (PLEG): container finished" podID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerID="c0f237d662fbd4f0bf32ccdec847e9c9c7dfe0a390b170c1ed0f6b01369ce488" exitCode=60
Oct 30 21:30:08.170445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.170406    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" event={"ID":"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b","Type":"ContainerDied","Data":"c0f237d662fbd4f0bf32ccdec847e9c9c7dfe0a390b170c1ed0f6b01369ce488"}
Oct 30 21:30:08.170900 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.170643    4943 scope.go:122] "RemoveContainer" containerID="c0f237d662fbd4f0bf32ccdec847e9c9c7dfe0a390b170c1ed0f6b01369ce488"
Oct 30 21:30:08.170900 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:08.170867    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm_odh-ai-gateway-infra(fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b"
Oct 30 21:30:08.171766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.171744    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" event={"ID":"74616002-631e-4d11-b33a-d970a68724f9","Type":"ContainerStarted","Data":"1d2e71e57a9b7206e557240b2ccb4179c87a6a1488566231288f8e3d16df223e"}
Oct 30 21:30:08.192501 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.192481    4943 scope.go:122] "RemoveContainer" containerID="cba2edd8fd7144e3a8558ae41ba3878f928b8df7019b44fe631111324e4d4b85"
Oct 30 21:30:08.205610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:08.205594    4943 scope.go:122] "RemoveContainer" containerID="03e69d42dfcf877bd64ae437d6d0810d97aa2a2ec77c16bb80018463e458b613"
Oct 30 21:30:09.183635 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:09.183609    4943 scope.go:122] "RemoveContainer" containerID="656ae3af080778dc5c75931c9b6b81428fd7dae6d4a5103202bb3046ac0a4f0e"
Oct 30 21:30:09.184125 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:09.183884    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj_odh-ai-gateway-infra(3854a067-b3a5-436f-acd3-5d2fadf93672)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672"
Oct 30 21:30:09.186332 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:09.186306    4943 scope.go:122] "RemoveContainer" containerID="c0f237d662fbd4f0bf32ccdec847e9c9c7dfe0a390b170c1ed0f6b01369ce488"
Oct 30 21:30:09.186543 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:09.186520    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm_odh-ai-gateway-infra(fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b"
Oct 30 21:30:09.188677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:09.188653    4943 scope.go:122] "RemoveContainer" containerID="87646f3d3eac843261ccb8b5b8612a80ab2a463b7e96d1a4096296d98ad0318e"
Oct 30 21:30:09.188878 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:09.188856    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg_odh-ai-gateway-infra(be8490e1-b77d-45eb-9aad-b1bc2c40c3e5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5"
Oct 30 21:30:11.210143 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:11.210107    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" event={"ID":"74616002-631e-4d11-b33a-d970a68724f9","Type":"ContainerStarted","Data":"4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db"}
Oct 30 21:30:11.326404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:11.326352    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podStartSLOduration=2.021610918 podStartE2EDuration="4.326338327s" totalImagesPullingTime="2.304727409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:11.323304667 +0000 UTC m=+805.818878019" watchObservedRunningTime="2026-10-30 21:30:11.326338327 +0000 UTC m=+805.821911678"
Oct 30 21:30:11.707443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:11.707407    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:11.820144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:11.820110    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:12.129259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:12.129139    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:13.762386 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:13.762349    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:14.398738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:14.398701    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:14.600401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:14.600372    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:16.639289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:16.639252    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:17.046162 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:17.046086    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:17.707254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:17.707220    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:17.720080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:17.720055    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:18.262633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:18.262600    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:30:18.611212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:18.611128    4943 scope.go:122] "RemoveContainer" containerID="c0f237d662fbd4f0bf32ccdec847e9c9c7dfe0a390b170c1ed0f6b01369ce488"
Oct 30 21:30:19.258254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:19.258213    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" event={"ID":"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b","Type":"ContainerStarted","Data":"d4b31ae21f2e756f5cb53651a665e79460989a55bf0ff2579c31c00acee5f4a7"}
Oct 30 21:30:19.371348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:19.371295    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" podStartSLOduration=14.582741986 podStartE2EDuration="19.371282468s" totalImagesPullingTime="4.788540482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:19.369775866 +0000 UTC m=+813.865349216" watchObservedRunningTime="2026-10-30 21:30:19.371282468 +0000 UTC m=+813.866855819"
Oct 30 21:30:20.269261 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:20.269227    4943 generic.go:356] "Generic (PLEG): container finished" podID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerID="d4b31ae21f2e756f5cb53651a665e79460989a55bf0ff2579c31c00acee5f4a7" exitCode=60
Oct 30 21:30:20.269766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:20.269268    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" event={"ID":"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b","Type":"ContainerDied","Data":"d4b31ae21f2e756f5cb53651a665e79460989a55bf0ff2579c31c00acee5f4a7"}
Oct 30 21:30:20.269766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:20.269313    4943 scope.go:122] "RemoveContainer" containerID="c0f237d662fbd4f0bf32ccdec847e9c9c7dfe0a390b170c1ed0f6b01369ce488"
Oct 30 21:30:20.269766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:20.269702    4943 scope.go:122] "RemoveContainer" containerID="d4b31ae21f2e756f5cb53651a665e79460989a55bf0ff2579c31c00acee5f4a7"
Oct 30 21:30:20.270309 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:20.270005    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm_odh-ai-gateway-infra(fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b"
Oct 30 21:30:20.383300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:20.383257    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"]
Oct 30 21:30:21.091768 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:21.091730    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:30:21.441081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.441055    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:21.482631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.482594    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-maas-api-service-ca\") pod \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") "
Oct 30 21:30:21.482804 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.482679    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-kube-api-access-k84k6\" (UniqueName: \"kubernetes.io/projected/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-kube-api-access-k84k6\") pod \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\" (UID: \"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b\") "
Oct 30 21:30:21.483044 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.483012    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-maas-api-service-ca" pod "fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" (UID: "fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:21.484850 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.484829    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-kube-api-access-k84k6" pod "fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" (UID: "fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b"). InnerVolumeSpecName "kube-api-access-k84k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:21.584010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.583971    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k84k6\" (UniqueName: \"kubernetes.io/projected/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-kube-api-access-k84k6\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:21.584010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.584011    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:21.814362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:21.814314    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:22.301835 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:22.301808    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"
Oct 30 21:30:22.301835 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:22.301822    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm" event={"ID":"fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b","Type":"ContainerDied","Data":"7b7fcd28ee80964deb05a41d2f8c4a559ce1eb99fab52c4c695dfdc9d292c947"}
Oct 30 21:30:22.302070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:22.301879    4943 scope.go:122] "RemoveContainer" containerID="d4b31ae21f2e756f5cb53651a665e79460989a55bf0ff2579c31c00acee5f4a7"
Oct 30 21:30:22.463987 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:22.463948    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"]
Oct 30 21:30:22.512753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:22.512718    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w3-9796f1-29889930-56prm"]
Oct 30 21:30:22.611144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:22.611059    4943 scope.go:122] "RemoveContainer" containerID="87646f3d3eac843261ccb8b5b8612a80ab2a463b7e96d1a4096296d98ad0318e"
Oct 30 21:30:22.611370 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:22.611351    4943 scope.go:122] "RemoveContainer" containerID="656ae3af080778dc5c75931c9b6b81428fd7dae6d4a5103202bb3046ac0a4f0e"
Oct 30 21:30:23.310351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:23.310317    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" event={"ID":"3854a067-b3a5-436f-acd3-5d2fadf93672","Type":"ContainerStarted","Data":"54587e8a502dc7fc74fab95676cf6f6fb257363a8c645982e0e1be99f842ce4d"}
Oct 30 21:30:23.313276 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:23.313251    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" event={"ID":"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5","Type":"ContainerStarted","Data":"ba7457c0278eb76d4b0715b7f9f136a6b022a462d0a9ee5cc231aa29f5502c07"}
Oct 30 21:30:23.617485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:23.617413    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" path="/var/lib/kubelet/pods/fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b/volumes"
Oct 30 21:30:23.725652 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:23.725621    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:24.321215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.321178    4943 generic.go:356] "Generic (PLEG): container finished" podID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerID="ba7457c0278eb76d4b0715b7f9f136a6b022a462d0a9ee5cc231aa29f5502c07" exitCode=60
Oct 30 21:30:24.321393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.321251    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" event={"ID":"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5","Type":"ContainerDied","Data":"ba7457c0278eb76d4b0715b7f9f136a6b022a462d0a9ee5cc231aa29f5502c07"}
Oct 30 21:30:24.321393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.321335    4943 scope.go:122] "RemoveContainer" containerID="87646f3d3eac843261ccb8b5b8612a80ab2a463b7e96d1a4096296d98ad0318e"
Oct 30 21:30:24.321756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.321728    4943 scope.go:122] "RemoveContainer" containerID="ba7457c0278eb76d4b0715b7f9f136a6b022a462d0a9ee5cc231aa29f5502c07"
Oct 30 21:30:24.322044 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:24.322021    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg_odh-ai-gateway-infra(be8490e1-b77d-45eb-9aad-b1bc2c40c3e5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5"
Oct 30 21:30:24.323614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.323592    4943 generic.go:356] "Generic (PLEG): container finished" podID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerID="54587e8a502dc7fc74fab95676cf6f6fb257363a8c645982e0e1be99f842ce4d" exitCode=60
Oct 30 21:30:24.323698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.323647    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" event={"ID":"3854a067-b3a5-436f-acd3-5d2fadf93672","Type":"ContainerDied","Data":"54587e8a502dc7fc74fab95676cf6f6fb257363a8c645982e0e1be99f842ce4d"}
Oct 30 21:30:24.324002 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.323986    4943 scope.go:122] "RemoveContainer" containerID="54587e8a502dc7fc74fab95676cf6f6fb257363a8c645982e0e1be99f842ce4d"
Oct 30 21:30:24.324277 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:24.324256    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj_odh-ai-gateway-infra(3854a067-b3a5-436f-acd3-5d2fadf93672)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672"
Oct 30 21:30:24.333783 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.333765    4943 scope.go:122] "RemoveContainer" containerID="656ae3af080778dc5c75931c9b6b81428fd7dae6d4a5103202bb3046ac0a4f0e"
Oct 30 21:30:24.434022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.433994    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"]
Oct 30 21:30:24.548654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:24.548615    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"]
Oct 30 21:30:25.507422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.507398    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:25.509629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.509607    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:25.626450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626381    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3854a067-b3a5-436f-acd3-5d2fadf93672-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3854a067-b3a5-436f-acd3-5d2fadf93672-maas-api-service-ca\") pod \"3854a067-b3a5-436f-acd3-5d2fadf93672\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") "
Oct 30 21:30:25.626577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626452    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-maas-api-service-ca\") pod \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") "
Oct 30 21:30:25.626626 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626588    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3854a067-b3a5-436f-acd3-5d2fadf93672-kube-api-access-2tkwl\" (UniqueName: \"kubernetes.io/projected/3854a067-b3a5-436f-acd3-5d2fadf93672-kube-api-access-2tkwl\") pod \"3854a067-b3a5-436f-acd3-5d2fadf93672\" (UID: \"3854a067-b3a5-436f-acd3-5d2fadf93672\") "
Oct 30 21:30:25.626663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626639    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-kube-api-access-7dlx9\" (UniqueName: \"kubernetes.io/projected/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-kube-api-access-7dlx9\") pod \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\" (UID: \"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5\") "
Oct 30 21:30:25.626797 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626770    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3854a067-b3a5-436f-acd3-5d2fadf93672-maas-api-service-ca" pod "3854a067-b3a5-436f-acd3-5d2fadf93672" (UID: "3854a067-b3a5-436f-acd3-5d2fadf93672"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:25.626839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626791    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-maas-api-service-ca" pod "be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" (UID: "be8490e1-b77d-45eb-9aad-b1bc2c40c3e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:30:25.626940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626926    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3854a067-b3a5-436f-acd3-5d2fadf93672-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:25.626998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.626944    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:25.628878 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.628856    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-kube-api-access-7dlx9" pod "be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" (UID: "be8490e1-b77d-45eb-9aad-b1bc2c40c3e5"). InnerVolumeSpecName "kube-api-access-7dlx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:25.629014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.628996    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3854a067-b3a5-436f-acd3-5d2fadf93672-kube-api-access-2tkwl" pod "3854a067-b3a5-436f-acd3-5d2fadf93672" (UID: "3854a067-b3a5-436f-acd3-5d2fadf93672"). InnerVolumeSpecName "kube-api-access-2tkwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:30:25.728244 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.728209    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tkwl\" (UniqueName: \"kubernetes.io/projected/3854a067-b3a5-436f-acd3-5d2fadf93672-kube-api-access-2tkwl\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:25.728244 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:25.728235    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dlx9\" (UniqueName: \"kubernetes.io/projected/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5-kube-api-access-7dlx9\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:30:26.340891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.340860    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"
Oct 30 21:30:26.341074 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.340892    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj" event={"ID":"3854a067-b3a5-436f-acd3-5d2fadf93672","Type":"ContainerDied","Data":"0a862c5be4e7c738c3909e1415f3e2afa179b6058d1edef5abdfc752bdee5d74"}
Oct 30 21:30:26.341074 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.340955    4943 scope.go:122] "RemoveContainer" containerID="54587e8a502dc7fc74fab95676cf6f6fb257363a8c645982e0e1be99f842ce4d"
Oct 30 21:30:26.342376 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.342356    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg" event={"ID":"be8490e1-b77d-45eb-9aad-b1bc2c40c3e5","Type":"ContainerDied","Data":"1051e99f1269291f31199318757dd895f4101977c33329cdf664f009cde19bd5"}
Oct 30 21:30:26.342480 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.342358    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"
Oct 30 21:30:26.351204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.351179    4943 scope.go:122] "RemoveContainer" containerID="ba7457c0278eb76d4b0715b7f9f136a6b022a462d0a9ee5cc231aa29f5502c07"
Oct 30 21:30:26.507004 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.506973    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"]
Oct 30 21:30:26.510523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.510497    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w5-021907-29889930-79skg"]
Oct 30 21:30:26.618831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.618770    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"]
Oct 30 21:30:26.625567 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.625533    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889930-xddhj"]
Oct 30 21:30:26.809303 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:26.809258    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:27.621815 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:27.621777    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" path="/var/lib/kubelet/pods/3854a067-b3a5-436f-acd3-5d2fadf93672/volumes"
Oct 30 21:30:27.622358 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:27.622339    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" path="/var/lib/kubelet/pods/be8490e1-b77d-45eb-9aad-b1bc2c40c3e5/volumes"
Oct 30 21:30:31.510955 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:31.510915    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:33.858163 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:33.858109    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:34.039090 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:34.039050    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:36.287326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.287294    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:36.983049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983018    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"]
Oct 30 21:30:36.983449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983436    4943 cpu_manager.go:414] "containerMap: removing container" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:30:36.983499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983450    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:30:36.983499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983479    4943 cpu_manager.go:414] "containerMap: removing container" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983484    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983494    4943 cpu_manager.go:414] "containerMap: removing container" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983499    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983506    4943 cpu_manager.go:414] "containerMap: removing container" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983511    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983519    4943 cpu_manager.go:414] "containerMap: removing container" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983524    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983530    4943 cpu_manager.go:414] "containerMap: removing container" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983534    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983540    4943 cpu_manager.go:414] "containerMap: removing container" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983544    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983548    4943 cpu_manager.go:414] "containerMap: removing container" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983568    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983658    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983666    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983672    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983678    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.983679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983683    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.984142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983690    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="fbe8804a-4cb9-4964-8ce0-b9cda1c6d85b" containerName="cleanup"
Oct 30 21:30:36.984142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983694    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:30:36.984142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.983699    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="be8490e1-b77d-45eb-9aad-b1bc2c40c3e5" containerName="cleanup"
Oct 30 21:30:36.986653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:36.986637    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.062279 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.062249    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"]
Oct 30 21:30:37.088818 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.088786    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-9796f1\"/\"openshift-service-ca.crt\""
Oct 30 21:30:37.088818 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.088786    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-9796f1\"/\"kube-root-ca.crt\""
Oct 30 21:30:37.089025 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.088861    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-9796f1\"/\"premium-w3-9796f1-kserve-self-signed-certs\""
Oct 30 21:30:37.089025 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.088917    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-9796f1\"/\"default-dockercfg-4fd4p\""
Oct 30 21:30:37.111800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.111774    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:37.137177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.137140    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-dshm\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.137424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.137399    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg78j\" (UniqueName: \"kubernetes.io/projected/3c6000b6-eebe-41da-981f-f1e9307089f6-kube-api-access-rg78j\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.137539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.137458    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-tmp-dir\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.137614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.137543    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-home\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.137658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.137621    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6000b6-eebe-41da-981f-f1e9307089f6-tls-certs\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.137658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.137648    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-model-cache\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.238610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.238520    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg78j\" (UniqueName: \"kubernetes.io/projected/3c6000b6-eebe-41da-981f-f1e9307089f6-kube-api-access-rg78j\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.238773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.238659    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-tmp-dir\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.238773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.238683    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-home\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.238773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.238698    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6000b6-eebe-41da-981f-f1e9307089f6-tls-certs\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.238773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.238716    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-model-cache\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.238929 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.238835    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-dshm\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.239161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.239135    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-home\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.239226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.239162    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-tmp-dir\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.239226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.239171    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-model-cache\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.241215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.241189    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-dshm\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.241458 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.241437    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6000b6-eebe-41da-981f-f1e9307089f6-tls-certs\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.297625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.297589    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg78j\" (UniqueName: \"kubernetes.io/projected/3c6000b6-eebe-41da-981f-f1e9307089f6-kube-api-access-rg78j\") pod \"premium-w3-9796f1-kserve-75465fc489-wr99j\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") " pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.298228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.298200    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:37.718458 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:37.718423    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"]
Oct 30 21:30:37.720580 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:30:37.720528    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c6000b6_eebe_41da_981f_f1e9307089f6.slice/crio-030fa9cd2361a6d2fd729fa7fa24d4f885621c5d4698dc6abfadc21380e8d396 WatchSource:0}: Error finding container 030fa9cd2361a6d2fd729fa7fa24d4f885621c5d4698dc6abfadc21380e8d396: Status 404 returned error can't find the container with id 030fa9cd2361a6d2fd729fa7fa24d4f885621c5d4698dc6abfadc21380e8d396
Oct 30 21:30:38.421523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:38.421480    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" event={"ID":"3c6000b6-eebe-41da-981f-f1e9307089f6","Type":"ContainerStarted","Data":"91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35"}
Oct 30 21:30:38.421936 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:38.421535    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" event={"ID":"3c6000b6-eebe-41da-981f-f1e9307089f6","Type":"ContainerStarted","Data":"030fa9cd2361a6d2fd729fa7fa24d4f885621c5d4698dc6abfadc21380e8d396"}
Oct 30 21:30:38.538329 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:38.538274    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podStartSLOduration=2.538257781 podStartE2EDuration="2.538257781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:30:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:30:38.536365116 +0000 UTC m=+833.031938466" watchObservedRunningTime="2026-10-30 21:30:38.538257781 +0000 UTC m=+833.033831132"
Oct 30 21:30:38.935947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:38.935905    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:39.298955 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:39.298881    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:39.548113 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:39.548084    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:39.736536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:39.736501    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:40.695347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:40.695311    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:40.874848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:40.874819    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:41.312017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:41.311986    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:44.465628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:44.465597    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:44.663661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:44.663628    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:46.094656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:46.094543    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:47.298972 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:47.298935    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:47.312612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:47.312570    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:47.485416 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:47.485383    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:30:50.819781 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:50.819730    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:51.062873 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:30:51.062834    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:30:55.499826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:55.499786    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:30:56.304487 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:30:56.304451    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:00.196120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:00.196089    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:04.906061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:04.906021    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:08.255284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:08.255232    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:10.616288 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:10.616251    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:12.399206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:12.399090    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:14.401191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:14.401156    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:17.116046 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:17.116007    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:17.308142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:17.308103    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:19.184535 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:19.184504    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:21.062457 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:31:21.062423    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:31:23.906410 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:23.906373    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:25.390954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:25.390924    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:28.594710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:28.594676    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:33.303095 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:33.303060    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:38.057674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.057634    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"]
Oct 30 21:31:38.058281 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.058264    4943 cpu_manager.go:414] "containerMap: removing container" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:31:38.058336 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.058284    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:31:38.058473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.058462    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="3854a067-b3a5-436f-acd3-5d2fadf93672" containerName="cleanup"
Oct 30 21:31:38.062238 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.062218    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.096410 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.096376    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:38.118438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.118407    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"]
Oct 30 21:31:38.150870 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.150838    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2vbs\" (UniqueName: \"kubernetes.io/projected/585b14ad-5aa4-4c2e-8b92-aa3eee706914-kube-api-access-w2vbs\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.151011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.150876    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tls-certs\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.151011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.150916    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-home\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.151011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.150990    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-dshm\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.151178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.151018    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-model-cache\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.151178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.151167    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tmp-dir\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.163221 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.163198    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-07fa8e\"/\"openshift-service-ca.crt\""
Oct 30 21:31:38.163327 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.163222    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-07fa8e\"/\"kube-root-ca.crt\""
Oct 30 21:31:38.163467 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.163455    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-07fa8e\"/\"premium-w4-07fa8e-kserve-self-signed-certs\""
Oct 30 21:31:38.163774 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.163758    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-07fa8e\"/\"default-dockercfg-s2ptq\""
Oct 30 21:31:38.252565 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.252527    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2vbs\" (UniqueName: \"kubernetes.io/projected/585b14ad-5aa4-4c2e-8b92-aa3eee706914-kube-api-access-w2vbs\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.252765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.252589    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tls-certs\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.252765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.252629    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-home\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.252765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.252663    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-dshm\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.252765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.252686    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-model-cache\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.252992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.252796    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tmp-dir\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.253258 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.253208    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tmp-dir\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.253395 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.253333    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-model-cache\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.253395 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.253385    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-home\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.255393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.255369    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-dshm\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.255530 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.255394    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tls-certs\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.282392 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.282342    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:38.309431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.309363    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2vbs\" (UniqueName: \"kubernetes.io/projected/585b14ad-5aa4-4c2e-8b92-aa3eee706914-kube-api-access-w2vbs\") pod \"premium-w4-07fa8e-kserve-6957576dc5-srxw5\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") " pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.375631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.375592    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:38.770591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.770567    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"]
Oct 30 21:31:38.772594 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:31:38.772550    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod585b14ad_5aa4_4c2e_8b92_aa3eee706914.slice/crio-6393faaca29f98de96536903e55f2aacf66402be66fb80e062e76d574f936346 WatchSource:0}: Error finding container 6393faaca29f98de96536903e55f2aacf66402be66fb80e062e76d574f936346: Status 404 returned error can't find the container with id 6393faaca29f98de96536903e55f2aacf66402be66fb80e062e76d574f936346
Oct 30 21:31:38.796290 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:38.796258    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" event={"ID":"585b14ad-5aa4-4c2e-8b92-aa3eee706914","Type":"ContainerStarted","Data":"6393faaca29f98de96536903e55f2aacf66402be66fb80e062e76d574f936346"}
Oct 30 21:31:39.803032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:39.802993    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" event={"ID":"585b14ad-5aa4-4c2e-8b92-aa3eee706914","Type":"ContainerStarted","Data":"f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b"}
Oct 30 21:31:39.918740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:39.918688    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podStartSLOduration=1.918674177 podStartE2EDuration="1.918674177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:39.916120399 +0000 UTC m=+894.411693750" watchObservedRunningTime="2026-10-30 21:31:39.918674177 +0000 UTC m=+894.414247534"
Oct 30 21:31:40.376658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:40.376623    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:40.985745 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:40.985711    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:42.790951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:42.790915    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:45.733944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:45.733914    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:31:45.734986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:45.734966    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:31:47.499354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:47.498910    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:48.376280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:48.376236    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:48.388473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:48.388443    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:48.872477 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:48.872447    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:31:49.715465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:49.715428    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:51.062962 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:31:51.062928    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:31:52.200502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:52.200455    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:54.352339 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.352307    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"]
Oct 30 21:31:54.356238 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.356219    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.414203 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.414172    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"]
Oct 30 21:31:54.420700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.420667    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-model-cache\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.420853 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.420720    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9mx\" (UniqueName: \"kubernetes.io/projected/10c39742-4da4-468e-88d3-c08cb408d623-kube-api-access-6m9mx\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.420853 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.420824    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-dshm\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.420984 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.420966    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-home\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.421095 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.421074    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10c39742-4da4-468e-88d3-c08cb408d623-tls-certs\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.421163 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.421108    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-tmp-dir\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.460567 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.460534    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-021907\"/\"openshift-service-ca.crt\""
Oct 30 21:31:54.460719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.460599    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-021907\"/\"premium-w5-021907-kserve-self-signed-certs\""
Oct 30 21:31:54.460719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.460708    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-021907\"/\"kube-root-ca.crt\""
Oct 30 21:31:54.460807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.460710    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-021907\"/\"default-dockercfg-qzw2w\""
Oct 30 21:31:54.495533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.495498    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:54.522716 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.522680    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-home\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.522902 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.522852    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10c39742-4da4-468e-88d3-c08cb408d623-tls-certs\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.522902 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.522890    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-tmp-dir\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.523084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.523056    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-model-cache\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.523968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.523510    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9mx\" (UniqueName: \"kubernetes.io/projected/10c39742-4da4-468e-88d3-c08cb408d623-kube-api-access-6m9mx\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.523968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.523905    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-dshm\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.523968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.523928    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-model-cache\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.524207 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.524129    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-tmp-dir\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.529723 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.524632    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-home\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.529723 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.526356    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10c39742-4da4-468e-88d3-c08cb408d623-tls-certs\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.534362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.534338    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-dshm\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.580620 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.580584    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9mx\" (UniqueName: \"kubernetes.io/projected/10c39742-4da4-468e-88d3-c08cb408d623-kube-api-access-6m9mx\") pod \"premium-w5-021907-kserve-5b54c47654-c56n2\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") " pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:54.668249 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:54.668209    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:55.115646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:55.115615    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"]
Oct 30 21:31:55.117432 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:31:55.117396    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10c39742_4da4_468e_88d3_c08cb408d623.slice/crio-25f1078756ba847e0dab8fb6259d7495270eb258761f088159347ab228bc8562 WatchSource:0}: Error finding container 25f1078756ba847e0dab8fb6259d7495270eb258761f088159347ab228bc8562: Status 404 returned error can't find the container with id 25f1078756ba847e0dab8fb6259d7495270eb258761f088159347ab228bc8562
Oct 30 21:31:55.900584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:55.900519    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" event={"ID":"10c39742-4da4-468e-88d3-c08cb408d623","Type":"ContainerStarted","Data":"a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe"}
Oct 30 21:31:55.901007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:55.900595    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" event={"ID":"10c39742-4da4-468e-88d3-c08cb408d623","Type":"ContainerStarted","Data":"25f1078756ba847e0dab8fb6259d7495270eb258761f088159347ab228bc8562"}
Oct 30 21:31:56.021241 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:56.021193    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podStartSLOduration=2.021177416 podStartE2EDuration="2.021177416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:31:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:31:56.017691953 +0000 UTC m=+910.513265303" watchObservedRunningTime="2026-10-30 21:31:56.021177416 +0000 UTC m=+910.516750768"
Oct 30 21:31:56.668868 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:56.668838    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:31:56.994212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:56.994128    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:31:59.327294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:31:59.327255    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:01.701913 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:01.701874    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:04.668655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:04.668623    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:32:04.681133 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:04.681111    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:32:04.993661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:04.993584    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:32:06.394674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:06.394628    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:11.124941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:11.124900    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:15.884505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:15.884465    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:20.597629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:20.597568    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:21.064354 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:32:21.064319    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:32:25.305584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:25.305518    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:26.946451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:26.946350    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:29.964481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:29.964440    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:30.512979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:30.512950    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:34.710039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:34.709945    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:39.616450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:39.616403    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:41.313515 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:41.313484    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:44.283634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:44.283598    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:48.982876 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:48.982826    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:51.062243 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:32:51.062207    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:32:52.514198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:52.514165    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:53.695079 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:53.695020    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:32:58.495391 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:32:58.495356    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:03.156541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:03.156501    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:04.089904 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:04.089865    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:04.793985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:04.793949    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:07.906702 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:07.906664    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:12.788827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:12.788785    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:17.588591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:17.588541    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:21.071986 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:33:21.071949    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:33:21.244793 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:21.244704    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:22.334466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:22.334371    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:27.083703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:27.083664    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:31.815538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:31.815502    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:36.499038 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:36.499005    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:41.214523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:41.214482    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:41.668943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:41.668891    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:45.024851 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:45.024804    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:46.010462 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:46.010422    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:50.701985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:50.701954    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:33:51.063320 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:33:51.063227    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:33:55.448070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:33:55.448031    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:00.099742 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:00.099633    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:04.819831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:04.819791    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:09.505615 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:09.505548    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:14.227961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:14.227930    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:18.997152 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:18.997121    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:21.064007 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:34:21.063966    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:34:21.400681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.400648    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"]
Oct 30 21:34:21.404604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.404582    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.408987    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94575f8-aa46-40d9-a852-1de7f7bd5277-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409023    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggwwp\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-kube-api-access-ggwwp\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409159    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409288 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409265    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409400 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409301    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409400 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409335    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409400 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409352    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409448    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.409523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.409484    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.457995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.457975    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-446ca2-openshift-default-dockercfg-2jv4g\""
Oct 30 21:34:21.508943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.508912    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"]
Oct 30 21:34:21.510919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.510898    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511012 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.510938    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94575f8-aa46-40d9-a852-1de7f7bd5277-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511012 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.510959    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggwwp\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-kube-api-access-ggwwp\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511012 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.510995    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511054    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511080    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511112    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511128    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511172    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511501 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511437    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511496    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511531    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511680    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.511757 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.511729    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94575f8-aa46-40d9-a852-1de7f7bd5277-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.513370 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.513352    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.513653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.513632    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.572478 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.572449    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.572793 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.572771    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggwwp\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-kube-api-access-ggwwp\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.689811 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.689729    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"]
Oct 30 21:34:21.694427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.694408    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.712997    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713054    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2ms4\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-kube-api-access-j2ms4\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713167 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713115    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713167 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713148    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713170    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817405c4-95b9-4d99-a283-717b7b075c76-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713244    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713338    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817405c4-95b9-4d99-a283-717b7b075c76-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713398 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713372    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.713444 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.713398    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.717880 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.717864    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:21.746722 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.746694    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-07fa8e-openshift-default-dockercfg-whqhj\""
Oct 30 21:34:21.754730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.754394    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"]
Oct 30 21:34:21.814020 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.813990    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817405c4-95b9-4d99-a283-717b7b075c76-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814034    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814061    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817405c4-95b9-4d99-a283-717b7b075c76-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814082    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814097    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814163    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814211    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2ms4\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-kube-api-access-j2ms4\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814232    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814261    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814541    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814699    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.814887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.814862    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817405c4-95b9-4d99-a283-717b7b075c76-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.815136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.815114    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.815311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.815289    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.816761 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.816727    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.817097 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.817076    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817405c4-95b9-4d99-a283-717b7b075c76-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.871346 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.871310    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2ms4\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-kube-api-access-j2ms4\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:21.871475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:21.871376    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:22.008205 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.008130    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:22.156022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.155988    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"]
Oct 30 21:34:22.157239 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:34:22.157206    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94575f8_aa46_40d9_a852_1de7f7bd5277.slice/crio-3ba1e81ad3d296d441955e0443b7d6877b0c79763486df4a93628eb0289e0bee WatchSource:0}: Error finding container 3ba1e81ad3d296d441955e0443b7d6877b0c79763486df4a93628eb0289e0bee: Status 404 returned error can't find the container with id 3ba1e81ad3d296d441955e0443b7d6877b0c79763486df4a93628eb0289e0bee
Oct 30 21:34:22.159958 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.159920    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:22.160062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.159988    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:22.160062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.160021    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:22.398646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.398615    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"]
Oct 30 21:34:22.400589 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:34:22.400542    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod817405c4_95b9_4d99_a283_717b7b075c76.slice/crio-1b884311c852428df41a395eb678155b56cb986564a43f06b1a011dbd8d93ccc WatchSource:0}: Error finding container 1b884311c852428df41a395eb678155b56cb986564a43f06b1a011dbd8d93ccc: Status 404 returned error can't find the container with id 1b884311c852428df41a395eb678155b56cb986564a43f06b1a011dbd8d93ccc
Oct 30 21:34:22.403414 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.403377    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:22.403505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.403465    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:22.403549 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.403508    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:22.917580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.905722    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" event={"ID":"817405c4-95b9-4d99-a283-717b7b075c76","Type":"ContainerStarted","Data":"20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465"}
Oct 30 21:34:22.917580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.905789    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" event={"ID":"817405c4-95b9-4d99-a283-717b7b075c76","Type":"ContainerStarted","Data":"1b884311c852428df41a395eb678155b56cb986564a43f06b1a011dbd8d93ccc"}
Oct 30 21:34:22.917580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.909167    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" event={"ID":"c94575f8-aa46-40d9-a852-1de7f7bd5277","Type":"ContainerStarted","Data":"4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d"}
Oct 30 21:34:22.917580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:22.909241    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" event={"ID":"c94575f8-aa46-40d9-a852-1de7f7bd5277","Type":"ContainerStarted","Data":"3ba1e81ad3d296d441955e0443b7d6877b0c79763486df4a93628eb0289e0bee"}
Oct 30 21:34:23.009707 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.009500    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:23.013575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.011259    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:34:23.013575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.011328    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 21:34:23.025268 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.025226    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podStartSLOduration=2.02521291 podStartE2EDuration="2.02521291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:23.024996742 +0000 UTC m=+1057.520570092" watchObservedRunningTime="2026-10-30 21:34:23.02521291 +0000 UTC m=+1057.520786261"
Oct 30 21:34:23.718748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.718719    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:23.720773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.720740    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:34:23.720907 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.720810    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 21:34:23.962584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:23.948831    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:24.010161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:24.010044    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:34:24.010463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:24.010417    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 21:34:24.727580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:24.726985    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:34:24.727580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:24.727050    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 21:34:25.009454 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:25.009375    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:34:25.009454 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:25.009433    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 21:34:25.718880 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:25.718842    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:34:25.719060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:25.718898    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 21:34:26.008843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:26.008750    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:34:26.008843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:26.008814    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 21:34:26.718924 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:26.718893    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:34:26.719188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:26.719150    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 21:34:27.009169 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:27.009066    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:34:27.009169 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:27.009136    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 21:34:27.719399 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:27.719353    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:34:27.719637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:27.719446    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 21:34:28.009603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:28.009489    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:34:28.009603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:28.009544    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 21:34:28.718635 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:28.718594    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Oct 30 21:34:28.718813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:28.718661    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Oct 30 21:34:29.008733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:29.008653    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Oct 30 21:34:29.008733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:29.008719    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Oct 30 21:34:29.089633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:29.089594    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:30.013220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:30.013186    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:30.013622 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:30.013591    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:30.014645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:30.014621    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 21:34:30.181080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:30.181015    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podStartSLOduration=9.180997378 podStartE2EDuration="9.180997378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:23.157905436 +0000 UTC m=+1057.653478789" watchObservedRunningTime="2026-10-30 21:34:30.180997378 +0000 UTC m=+1064.676570729"
Oct 30 21:34:30.281284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:30.281205    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:30.281515 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:30.281493    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:30.283618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:30.283595    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:34:33.351061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.351027    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"]
Oct 30 21:34:33.351459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.351217    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy" containerID="cri-o://55e4003f626146f6db857148fc669dc0f46405cbce2f3f04e4b9eda053ae758c" gracePeriod=30
Oct 30 21:34:33.401065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.401028    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"]
Oct 30 21:34:33.405061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.405037    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.456756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.456728    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-021907-openshift-default-dockercfg-dm7nx\""
Oct 30 21:34:33.513662 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.513631    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"]
Oct 30 21:34:33.532651 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.532623    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.532814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.532655    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.532814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.532743    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4199b30-045a-4531-98cc-98a260d9dd70-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.532814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.532766    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.533054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.532860    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnm6b\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-kube-api-access-jnm6b\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.533054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.532928    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4199b30-045a-4531-98cc-98a260d9dd70-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.533054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.532980    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.533054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.533034    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.533287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.533076    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635213 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635117    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635259    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635292    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635351    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4199b30-045a-4531-98cc-98a260d9dd70-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635379    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635443    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnm6b\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-kube-api-access-jnm6b\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635497    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4199b30-045a-4531-98cc-98a260d9dd70-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635550    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.635738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.635623    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.636153 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.636109    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.637354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.636439    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.637354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.636726    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.637354 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.636957    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.640161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.640135    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4199b30-045a-4531-98cc-98a260d9dd70-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.640647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.640622    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4199b30-045a-4531-98cc-98a260d9dd70-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.642487 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.642461    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.695637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.695609    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.696124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.696099    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnm6b\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-kube-api-access-jnm6b\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.721055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.721030    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:33.893361 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:33.893282    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:34.151799 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:34.151772    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"]
Oct 30 21:34:34.153715 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:34:34.153688    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4199b30_045a_4531_98cc_98a260d9dd70.slice/crio-68e69a0dc88cb91a129b74760797907b8cf9518f1b738f62440e71dbfc995875 WatchSource:0}: Error finding container 68e69a0dc88cb91a129b74760797907b8cf9518f1b738f62440e71dbfc995875: Status 404 returned error can't find the container with id 68e69a0dc88cb91a129b74760797907b8cf9518f1b738f62440e71dbfc995875
Oct 30 21:34:34.155945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:34.155913    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:34.156026 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:34.155975    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:34.156026 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:34.156002    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:34:35.079577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:35.079364    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" event={"ID":"f4199b30-045a-4531-98cc-98a260d9dd70","Type":"ContainerStarted","Data":"5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d"}
Oct 30 21:34:35.079577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:35.079432    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" event={"ID":"f4199b30-045a-4531-98cc-98a260d9dd70","Type":"ContainerStarted","Data":"68e69a0dc88cb91a129b74760797907b8cf9518f1b738f62440e71dbfc995875"}
Oct 30 21:34:35.297654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:35.297599    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" podStartSLOduration=2.297583884 podStartE2EDuration="2.297583884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:35.246999139 +0000 UTC m=+1069.742572498" watchObservedRunningTime="2026-10-30 21:34:35.297583884 +0000 UTC m=+1069.793157235"
Oct 30 21:34:35.721284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:35.721253    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:35.723058 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:35.723030    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:34:35.723216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:35.723084    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 21:34:36.721668 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:36.721632    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:34:36.722059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:36.721686    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 21:34:37.721571 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:37.721522    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:34:37.721746 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:37.721611    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 21:34:38.687419 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:38.687380    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:38.725122 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:38.725084    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:34:38.725619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:38.725154    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 21:34:38.888592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:38.888271    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:39.115886 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.115850    4943 generic.go:356] "Generic (PLEG): container finished" podID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerID="55e4003f626146f6db857148fc669dc0f46405cbce2f3f04e4b9eda053ae758c" exitCode=0
Oct 30 21:34:39.116041 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.115998    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" event={"ID":"4751d961-fd98-4419-9c0b-0bde40ffef5e","Type":"ContainerDied","Data":"55e4003f626146f6db857148fc669dc0f46405cbce2f3f04e4b9eda053ae758c"}
Oct 30 21:34:39.151052 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.150717    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:34:39.316486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316393    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-data\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316450    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-kube-api-access-pjb7l\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-kube-api-access-pjb7l\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316524    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-envoy\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316634    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-podinfo\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316678    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4751d961-fd98-4419-9c0b-0bde40ffef5e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4751d961-fd98-4419-9c0b-0bde40ffef5e-istiod-ca-cert\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316754    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-certs\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316796    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-socket\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316832    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-credential-socket\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.316894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.316874    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-token\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-token\") pod \"4751d961-fd98-4419-9c0b-0bde40ffef5e\" (UID: \"4751d961-fd98-4419-9c0b-0bde40ffef5e\") "
Oct 30 21:34:39.318042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.317352    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-certs" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:39.318042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.317659    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4751d961-fd98-4419-9c0b-0bde40ffef5e-istiod-ca-cert" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:34:39.318042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.317691    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-data" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:39.318042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.317795    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-socket" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:39.318042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.317915    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-credential-socket" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:39.320311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.320281    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-podinfo" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:34:39.320719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.320687    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-envoy" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:39.320833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.320807    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-kube-api-access-pjb7l" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "kube-api-access-pjb7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:34:39.321165 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.321142    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-token" pod "4751d961-fd98-4419-9c0b-0bde40ffef5e" (UID: "4751d961-fd98-4419-9c0b-0bde40ffef5e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:34:39.418152 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418117    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418152 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418147    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjb7l\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-kube-api-access-pjb7l\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418152 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418159    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418168    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418177    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4751d961-fd98-4419-9c0b-0bde40ffef5e-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418186    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418194    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418202    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4751d961-fd98-4419-9c0b-0bde40ffef5e-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.418382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.418211    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4751d961-fd98-4419-9c0b-0bde40ffef5e-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:39.721841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.721802    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body=
Oct 30 21:34:39.721986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:39.721861    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused"
Oct 30 21:34:40.124396 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.124358    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj" event={"ID":"4751d961-fd98-4419-9c0b-0bde40ffef5e","Type":"ContainerDied","Data":"ee5b16ef7898d6e1f91e735c77c26a8c30ae28bd91980e7c6cb8d6ddc8ab1cfe"}
Oct 30 21:34:40.124396 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.124391    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"
Oct 30 21:34:40.124933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.124433    4943 scope.go:122] "RemoveContainer" containerID="55e4003f626146f6db857148fc669dc0f46405cbce2f3f04e4b9eda053ae758c"
Oct 30 21:34:40.339660 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.339620    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"]
Oct 30 21:34:40.343987 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.343960    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-qg4kj"]
Oct 30 21:34:40.775434 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.775399    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:40.776314 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.776165    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:40.778232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:40.778212    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:34:41.617835 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:41.617802    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" path="/var/lib/kubelet/pods/4751d961-fd98-4419-9c0b-0bde40ffef5e/volumes"
Oct 30 21:34:41.989728 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:41.989696    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:43.580428 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:43.580391    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:48.391795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:48.391755    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:48.471353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:48.471316    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"]
Oct 30 21:34:48.471616 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:48.471570    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy" containerID="cri-o://e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe" gracePeriod=30
Oct 30 21:34:51.065179 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:34:51.065141    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:34:53.107239 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.107184    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:53.763321 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.763292    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:34:53.883860 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.883830    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-kube-api-access-crxqm\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-kube-api-access-crxqm\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.883874    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-certs\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.883924    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-token\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-token\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884020    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-envoy\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884075    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-socket\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884125    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-data\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884189    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-credential-socket\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884207    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-certs" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:53.884271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884247    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-podinfo\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884278    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istiod-ca-cert\") pod \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\" (UID: \"83afdef1-0d60-4f13-bce4-7bc2b09bddf4\") "
Oct 30 21:34:53.884437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884384    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-socket" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:53.884687 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884643    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-credential-socket" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:53.884807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884709    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-data" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:53.884807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884735    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.884807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884757    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.884807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884767    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istiod-ca-cert" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:34:53.884807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.884772    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.886171 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.886142    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-kube-api-access-crxqm" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "kube-api-access-crxqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:34:53.886346 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.886322    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-envoy" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:34:53.886601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.886581    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-podinfo" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:34:53.886676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.886587    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-token" pod "83afdef1-0d60-4f13-bce4-7bc2b09bddf4" (UID: "83afdef1-0d60-4f13-bce4-7bc2b09bddf4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:34:53.985582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.985532    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.985730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.985590    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.985730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.985602    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.985730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.985620    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.985730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.985631    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crxqm\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-kube-api-access-crxqm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:53.985730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:53.985642    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83afdef1-0d60-4f13-bce4-7bc2b09bddf4-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:34:54.150735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.150686    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"]
Oct 30 21:34:54.151170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.151155    4943 cpu_manager.go:414] "containerMap: removing container" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy"
Oct 30 21:34:54.151217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.151171    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy"
Oct 30 21:34:54.151217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.151189    4943 cpu_manager.go:414] "containerMap: removing container" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy"
Oct 30 21:34:54.151217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.151195    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy"
Oct 30 21:34:54.151309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.151277    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="4751d961-fd98-4419-9c0b-0bde40ffef5e" containerName="istio-proxy"
Oct 30 21:34:54.151309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.151291    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerName="istio-proxy"
Oct 30 21:34:54.155597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.155581    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.187980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.187957    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-home\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.188096 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.187996    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tls-certs\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.188096 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.188021    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-dshm\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.188185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.188165    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-model-cache\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.188269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.188253    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4zh2\" (UniqueName: \"kubernetes.io/projected/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-kube-api-access-r4zh2\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.188390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.188362    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tmp-dir\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.211571 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.211452    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-446ca2\"/\"openshift-service-ca.crt\""
Oct 30 21:34:54.211571 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.211510    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-446ca2\"/\"default-dockercfg-hqthv\""
Oct 30 21:34:54.211767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.211606    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-446ca2\"/\"kube-root-ca.crt\""
Oct 30 21:34:54.211968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.211948    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-446ca2\"/\"distinct-w2-446ca2-kserve-self-signed-certs\""
Oct 30 21:34:54.213059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.213038    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"]
Oct 30 21:34:54.237481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.237450    4943 generic.go:356] "Generic (PLEG): container finished" podID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" containerID="e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe" exitCode=0
Oct 30 21:34:54.237650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.237502    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"
Oct 30 21:34:54.237650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.237549    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" event={"ID":"83afdef1-0d60-4f13-bce4-7bc2b09bddf4","Type":"ContainerDied","Data":"e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe"}
Oct 30 21:34:54.237650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.237623    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6" event={"ID":"83afdef1-0d60-4f13-bce4-7bc2b09bddf4","Type":"ContainerDied","Data":"867da67ceaf5663753f60f5433f643bf2785eedad3de8623ebd63f44c062df2f"}
Oct 30 21:34:54.237829 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.237654    4943 scope.go:122] "RemoveContainer" containerID="e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe"
Oct 30 21:34:54.249287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.249271    4943 scope.go:122] "RemoveContainer" containerID="e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe"
Oct 30 21:34:54.249603 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:34:54.249578    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe\": container with ID starting with e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe not found: ID does not exist" containerID="e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe"
Oct 30 21:34:54.249693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.249605    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe"} err="failed to get container status \"e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe\": rpc error: code = NotFound desc = could not find container \"e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe\": container with ID starting with e415f5667d6c9f1403601c786d0448ba4c3dcada05e3eb9d86f108aad1579dbe not found: ID does not exist"
Oct 30 21:34:54.289986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.289960    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tmp-dir\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290003    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-home\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290028    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tls-certs\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290047    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-dshm\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290087    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-model-cache\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290123    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4zh2\" (UniqueName: \"kubernetes.io/projected/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-kube-api-access-r4zh2\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290397    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-home\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290421    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tmp-dir\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.290494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.290476    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-model-cache\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.292433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.292410    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-dshm\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.292548 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.292523    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tls-certs\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.307757 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.307707    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:34:54.347040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.347003    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4zh2\" (UniqueName: \"kubernetes.io/projected/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-kube-api-access-r4zh2\") pod \"distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") " pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.382947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.382915    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"]
Oct 30 21:34:54.386326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.386299    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-v8hp6"]
Oct 30 21:34:54.467962 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.467879    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:54.868382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:54.868027    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"]
Oct 30 21:34:54.871008 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:34:54.870973    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8092e5b2_176a_4a50_930e_b0d2cf4c20c3.slice/crio-52dbb93a2441d873286647f3b75cd249811be5baa9731a4f8a571960b11605b6 WatchSource:0}: Error finding container 52dbb93a2441d873286647f3b75cd249811be5baa9731a4f8a571960b11605b6: Status 404 returned error can't find the container with id 52dbb93a2441d873286647f3b75cd249811be5baa9731a4f8a571960b11605b6
Oct 30 21:34:55.245941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:55.245906    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" event={"ID":"8092e5b2-176a-4a50-930e-b0d2cf4c20c3","Type":"ContainerStarted","Data":"caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d"}
Oct 30 21:34:55.245941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:55.245946    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" event={"ID":"8092e5b2-176a-4a50-930e-b0d2cf4c20c3","Type":"ContainerStarted","Data":"52dbb93a2441d873286647f3b75cd249811be5baa9731a4f8a571960b11605b6"}
Oct 30 21:34:55.362957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:55.362909    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podStartSLOduration=1.3628951950000001 podStartE2EDuration="1.362895195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:34:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:34:55.360732795 +0000 UTC m=+1089.856306147" watchObservedRunningTime="2026-10-30 21:34:55.362895195 +0000 UTC m=+1089.858468543"
Oct 30 21:34:55.468538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:55.468498    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:34:55.617640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:55.617547    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83afdef1-0d60-4f13-bce4-7bc2b09bddf4" path="/var/lib/kubelet/pods/83afdef1-0d60-4f13-bce4-7bc2b09bddf4/volumes"
Oct 30 21:34:57.807118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:34:57.807085    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:02.500495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:02.500461    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:04.469027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:04.468983    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:35:04.485897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:04.485866    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:35:05.321130 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:05.321095    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:35:07.190027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:07.189986    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:09.545815 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:09.545730    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:11.993307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:11.993266    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:15.729284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.729250    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"]
Oct 30 21:35:15.733093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.733076    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.784900 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.784878    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-1b5b5f-openshift-default-dockercfg-kzsbh\""
Oct 30 21:35:15.837795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.837770    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"]
Oct 30 21:35:15.909050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909024    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909200 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909053    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909200 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909083    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909231    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909270    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk5xh\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-kube-api-access-tk5xh\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909355    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909384    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909470 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909458    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:15.909505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:15.909481    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010349    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010398    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk5xh\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-kube-api-access-tk5xh\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010435    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010461    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010503    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010530    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010578    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010601    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.010656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010642    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.011011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010859    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.011011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010908    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.011011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.010952    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.011423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.011392    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.011604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.011582    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.014115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.014086    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.014115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.014096    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.068275 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.068246    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.068549 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.068523    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk5xh\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-kube-api-access-tk5xh\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.345320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.345228    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:16.449586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.448988    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:16.723539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.722988    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:16.789706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.789678    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"]
Oct 30 21:35:16.791058 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:35:16.791026    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a5ff4c6_2fb8_4c18_b45c_8b26d5bb355a.slice/crio-1526cc972bb6bce4942dad582f1c71f87b0237d142c58294a5e73b3f0f59f98c WatchSource:0}: Error finding container 1526cc972bb6bce4942dad582f1c71f87b0237d142c58294a5e73b3f0f59f98c: Status 404 returned error can't find the container with id 1526cc972bb6bce4942dad582f1c71f87b0237d142c58294a5e73b3f0f59f98c
Oct 30 21:35:16.793594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.793518    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:35:16.793700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.793639    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:35:16.793700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:16.793673    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:35:17.392951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:17.392901    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" event={"ID":"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a","Type":"ContainerStarted","Data":"29342c7b4f5e3f081dcd34a7961c6729b3d14c518eb8c1784112225c99fd9181"}
Oct 30 21:35:17.393144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:17.392980    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" event={"ID":"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a","Type":"ContainerStarted","Data":"1526cc972bb6bce4942dad582f1c71f87b0237d142c58294a5e73b3f0f59f98c"}
Oct 30 21:35:17.514691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:17.514641    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podStartSLOduration=2.514627279 podStartE2EDuration="2.514627279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:35:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:35:17.512641895 +0000 UTC m=+1112.008215247" watchObservedRunningTime="2026-10-30 21:35:17.514627279 +0000 UTC m=+1112.010200620"
Oct 30 21:35:18.347475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:18.347443    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:18.348124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:18.348103    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:35:18.348268 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:18.348247    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:35:19.363580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:19.347984    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:35:19.363580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:19.348042    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:35:20.353581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:20.347921    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:35:20.353581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:20.347999    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:35:21.095840 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:35:21.095806    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:35:21.358655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:21.350841    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:35:21.358655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:21.350898    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:35:21.602766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:21.602728    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:22.353581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:22.351882    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:35:22.353581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:22.351943    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:35:23.345533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:23.345495    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Oct 30 21:35:23.345752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:23.345573    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Oct 30 21:35:24.350421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:24.350386    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:24.350914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:24.350840    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:24.351621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:24.351596    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 21:35:26.402720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:26.402685    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:31.196103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:31.196055    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:35.583855 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:35.583813    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:35.902435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:35.902404    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:40.599242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:40.599205    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:42.331131 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:42.331068    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:45.312401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:45.312350    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:45.483933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:45.483900    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:50.201031 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:50.200983    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:51.070871 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:35:51.070830    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:35:51.253704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:51.253667    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:54.899409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:54.899358    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:35:59.793418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:35:59.793383    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:04.518636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:04.518395    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:06.907200 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:06.907161    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"]
Oct 30 21:36:06.911362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:06.911339    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:06.963669 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:06.963640    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-e4dadd-openshift-default-dockercfg-vmhcw\""
Oct 30 21:36:07.017863 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.017833    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"]
Oct 30 21:36:07.032356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032325    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032427    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032491    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032509    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc94k\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-kube-api-access-sc94k\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032668 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032652    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032725 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032709    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032738    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032754    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.032866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.032771    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134085    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134179    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134207    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134232    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134263    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134507 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134332    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134507 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134400    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134507 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134492    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134531    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc94k\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-kube-api-access-sc94k\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134625    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134903 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134814    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134919    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134925    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.134978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.134925    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.136919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.136897    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.137149 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.137126    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.191085 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.191018    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.191250 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.191231    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc94k\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-kube-api-access-sc94k\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.224205 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.224173    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:07.656817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.656784    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"]
Oct 30 21:36:07.661180 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:36:07.661147    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7608c03_f0cd_472b_b7bb_c2b8945fd70e.slice/crio-3fabb3aff53a1e26e3c38382ba9e1989263190737b98a5f4e47ceb3fe3a4e600 WatchSource:0}: Error finding container 3fabb3aff53a1e26e3c38382ba9e1989263190737b98a5f4e47ceb3fe3a4e600: Status 404 returned error can't find the container with id 3fabb3aff53a1e26e3c38382ba9e1989263190737b98a5f4e47ceb3fe3a4e600
Oct 30 21:36:07.663430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.663398    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:36:07.663503 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.663465    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:36:07.663503 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.663495    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:36:07.757449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.757417    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" event={"ID":"a7608c03-f0cd-472b-b7bb-c2b8945fd70e","Type":"ContainerStarted","Data":"2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45"}
Oct 30 21:36:07.757662 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.757642    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" event={"ID":"a7608c03-f0cd-472b-b7bb-c2b8945fd70e","Type":"ContainerStarted","Data":"3fabb3aff53a1e26e3c38382ba9e1989263190737b98a5f4e47ceb3fe3a4e600"}
Oct 30 21:36:07.875926 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:07.875858    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podStartSLOduration=1.875843583 podStartE2EDuration="1.875843583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:36:07.872966486 +0000 UTC m=+1162.368539837" watchObservedRunningTime="2026-10-30 21:36:07.875843583 +0000 UTC m=+1162.371416933"
Oct 30 21:36:08.224478 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:08.224434    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:08.226193 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:08.226167    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:36:08.226343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:08.226211    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:36:09.224750 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:09.224715    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:36:09.225148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:09.224794    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:36:09.237300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:09.237270    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:10.224881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:10.224841    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:36:10.225323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:10.224922    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:36:11.224748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:11.224713    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:36:11.224921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:11.224769    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:36:12.225385 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:12.225349    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:36:12.225820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:12.225400    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:36:13.224763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:13.224725    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:36:13.224960 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:13.224780    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:36:14.000702 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:14.000641    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:14.224927 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:14.224895    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Oct 30 21:36:14.225093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:14.224948    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Oct 30 21:36:15.229463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:15.229429    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:15.229960 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:15.229938    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:15.230759 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:15.230735    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:36:18.629983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:18.629944    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:21.062935 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:36:21.062895    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:36:23.488978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:23.488934    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:28.283940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:28.283895    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:30.398579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:30.398519    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:33.012130 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:33.012056    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:37.688149 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:37.688115    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:42.412909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:42.412865    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:42.672068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:42.671983    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:43.507468 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:43.507431    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:43.695797 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:43.695766    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:45.782628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:45.782589    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:36:45.785271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:45.785245    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:36:47.069377 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:47.068631    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:51.062505 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:36:51.062466    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:36:51.883583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:51.883022    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:36:56.585731 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:36:56.585652    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:01.351236 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:01.351202    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:05.996441 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:05.996407    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:06.183506 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:06.183455    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:10.697434 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:10.697392    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:12.269242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:12.269205    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:15.376268 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:15.376235    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:20.087364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:20.087329    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:21.063112 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:37:21.063069    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:37:24.808954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:24.808907    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:29.507677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:29.507632    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:32.074462 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.074423    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"]
Oct 30 21:37:32.078394 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.078364    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.116721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.115844    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-dshm\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.116721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.115915    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv4bk\" (UniqueName: \"kubernetes.io/projected/585621e7-232f-46fd-a918-e102b539c9d3-kube-api-access-cv4bk\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.116721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.115945    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585621e7-232f-46fd-a918-e102b539c9d3-tls-certs\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.116721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.116065    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-tmp-dir\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.116721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.116108    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-home\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.116721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.116163    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-model-cache\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.169775 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.167834    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"]
Oct 30 21:37:32.187500 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.187467    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-9796f1\"/\"distinct-2-w3-9796f1-kserve-self-signed-certs\""
Oct 30 21:37:32.211740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.211705    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:32.217446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.217416    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-tmp-dir\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.217659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.217462    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-home\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.217659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.217504    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-model-cache\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.217659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.217569    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-dshm\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.217659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.217614    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv4bk\" (UniqueName: \"kubernetes.io/projected/585621e7-232f-46fd-a918-e102b539c9d3-kube-api-access-cv4bk\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.217659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.217642    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585621e7-232f-46fd-a918-e102b539c9d3-tls-certs\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.218030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.218008    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-home\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.218108 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.218023    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-tmp-dir\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.218343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.218294    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-model-cache\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.221386 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.221336    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-dshm\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.222771 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.222746    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585621e7-232f-46fd-a918-e102b539c9d3-tls-certs\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.278139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.278105    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv4bk\" (UniqueName: \"kubernetes.io/projected/585621e7-232f-46fd-a918-e102b539c9d3-kube-api-access-cv4bk\") pod \"distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") " pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.397428 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.397334    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:32.848504 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:32.848467    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"]
Oct 30 21:37:32.850179 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:37:32.850143    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod585621e7_232f_46fd_a918_e102b539c9d3.slice/crio-db0f9b8ca4e4a63507d3987fd95af81568da1cb882c8cac7f5816034dabfb823 WatchSource:0}: Error finding container db0f9b8ca4e4a63507d3987fd95af81568da1cb882c8cac7f5816034dabfb823: Status 404 returned error can't find the container with id db0f9b8ca4e4a63507d3987fd95af81568da1cb882c8cac7f5816034dabfb823
Oct 30 21:37:33.330027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:33.329989    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" event={"ID":"585621e7-232f-46fd-a918-e102b539c9d3","Type":"ContainerStarted","Data":"bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939"}
Oct 30 21:37:33.330487 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:33.330036    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" event={"ID":"585621e7-232f-46fd-a918-e102b539c9d3","Type":"ContainerStarted","Data":"db0f9b8ca4e4a63507d3987fd95af81568da1cb882c8cac7f5816034dabfb823"}
Oct 30 21:37:33.398272 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:33.398238    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:33.445891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:33.445842    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podStartSLOduration=1.44582957 podStartE2EDuration="1.44582957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:33.442619718 +0000 UTC m=+1247.938193071" watchObservedRunningTime="2026-10-30 21:37:33.44582957 +0000 UTC m=+1247.941402921"
Oct 30 21:37:34.284548 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:34.284491    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:34.727330 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:34.727293    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"]
Oct 30 21:37:34.727821 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:34.727532    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy" containerID="cri-o://0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf" gracePeriod=30
Oct 30 21:37:39.022946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.022882    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:39.751416 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.751386    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"]
Oct 30 21:37:39.755329 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.755306    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.811680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.811547    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgg5g\" (UniqueName: \"kubernetes.io/projected/e5235049-e55c-40f7-bc8a-ca5d63b39946-kube-api-access-dgg5g\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.811680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.811658    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-dshm\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.811897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.811779    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-model-cache\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.811897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.811814    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-home\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.811897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.811884    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-tmp-dir\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.812090 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.811946    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5235049-e55c-40f7-bc8a-ca5d63b39946-tls-certs\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.857082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.857048    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-e4dadd\"/\"distinct-2-w1-e4dadd-kserve-self-signed-certs\""
Oct 30 21:37:39.864585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.862723    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"]
Oct 30 21:37:39.906062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.905979    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.916823    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-tmp-dir\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.916896    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5235049-e55c-40f7-bc8a-ca5d63b39946-tls-certs\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.916998    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgg5g\" (UniqueName: \"kubernetes.io/projected/e5235049-e55c-40f7-bc8a-ca5d63b39946-kube-api-access-dgg5g\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.917036    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-dshm\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.917103    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-model-cache\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.917131    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-home\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.917591    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-home\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.917864    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-tmp-dir\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.919018    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-model-cache\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.924545    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5235049-e55c-40f7-bc8a-ca5d63b39946-tls-certs\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.931820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.930398    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-dshm\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:39.993617 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:39.978483    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgg5g\" (UniqueName: \"kubernetes.io/projected/e5235049-e55c-40f7-bc8a-ca5d63b39946-kube-api-access-dgg5g\") pod \"distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") " pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:40.044233 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.044198    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.120966    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-podinfo\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.121093    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-envoy\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.121364    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-certs\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.121433    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-token\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-token\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.121508    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3788014-47c8-491d-8f92-18bf1b08c7d3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3788014-47c8-491d-8f92-18bf1b08c7d3-istiod-ca-cert\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.121796    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-kube-api-access-9vxpp\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-kube-api-access-9vxpp\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.121838    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-credential-socket\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.122097    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-socket\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.122576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.122167    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-data\") pod \"b3788014-47c8-491d-8f92-18bf1b08c7d3\" (UID: \"b3788014-47c8-491d-8f92-18bf1b08c7d3\") "
Oct 30 21:37:40.147577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.144036    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-data" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:37:40.147577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.144412    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3788014-47c8-491d-8f92-18bf1b08c7d3-istiod-ca-cert" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:37:40.147577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.144807    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-credential-socket" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:37:40.147577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.144967    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-socket" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:37:40.147577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.146172    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:40.152863 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.151999    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-certs" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:37:40.172629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.171396    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-token" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:40.177052 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.177009    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-envoy" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:37:40.178098 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.177014    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-kube-api-access-9vxpp" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "kube-api-access-9vxpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:37:40.178425 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.178399    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-podinfo" pod "b3788014-47c8-491d-8f92-18bf1b08c7d3" (UID: "b3788014-47c8-491d-8f92-18bf1b08c7d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236767    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236803    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236818    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3788014-47c8-491d-8f92-18bf1b08c7d3-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236834    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vxpp\" (UniqueName: \"kubernetes.io/projected/b3788014-47c8-491d-8f92-18bf1b08c7d3-kube-api-access-9vxpp\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236849    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236863    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236877    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236891    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.237019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.236904    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3788014-47c8-491d-8f92-18bf1b08c7d3-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:37:40.377946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.377851    4943 generic.go:356] "Generic (PLEG): container finished" podID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerID="0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf" exitCode=0
Oct 30 21:37:40.378187 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.378064    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"
Oct 30 21:37:40.378346 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.378061    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" event={"ID":"b3788014-47c8-491d-8f92-18bf1b08c7d3","Type":"ContainerDied","Data":"0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf"}
Oct 30 21:37:40.378475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.378451    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc" event={"ID":"b3788014-47c8-491d-8f92-18bf1b08c7d3","Type":"ContainerDied","Data":"ef0251cb2056dc2f3333ec3fe3c0e7b7918ac9d3837cce480fcb90dd20bb301b"}
Oct 30 21:37:40.378544 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.378496    4943 scope.go:122] "RemoveContainer" containerID="0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf"
Oct 30 21:37:40.390332 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.390314    4943 scope.go:122] "RemoveContainer" containerID="0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273"
Oct 30 21:37:40.399140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.399123    4943 scope.go:122] "RemoveContainer" containerID="0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf"
Oct 30 21:37:40.399390 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:37:40.399369    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf\": container with ID starting with 0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf not found: ID does not exist" containerID="0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf"
Oct 30 21:37:40.399460 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.399398    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf"} err="failed to get container status \"0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf\": rpc error: code = NotFound desc = could not find container \"0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf\": container with ID starting with 0e4b494d25ec4debc24e5dbe164ab3298674c4603d9f3b3b698bb865f01546cf not found: ID does not exist"
Oct 30 21:37:40.399460 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.399419    4943 scope.go:122] "RemoveContainer" containerID="0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273"
Oct 30 21:37:40.399699 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:37:40.399675    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273\": container with ID starting with 0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273 not found: ID does not exist" containerID="0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273"
Oct 30 21:37:40.399796 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.399704    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273"} err="failed to get container status \"0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273\": rpc error: code = NotFound desc = could not find container \"0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273\": container with ID starting with 0d6d1043eb7435f95839014710456e17cea820240e9bb71b522894c4a95fa273 not found: ID does not exist"
Oct 30 21:37:40.541843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.541810    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"]
Oct 30 21:37:40.591285 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.591248    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-fcgrc"]
Oct 30 21:37:40.593826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:40.593804    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"]
Oct 30 21:37:40.599459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:37:40.599432    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5235049_e55c_40f7_bc8a_ca5d63b39946.slice/crio-f155896275986a4267972c9d0ada0ccb4e9575006db6985f46e5f64387fe6e94 WatchSource:0}: Error finding container f155896275986a4267972c9d0ada0ccb4e9575006db6985f46e5f64387fe6e94: Status 404 returned error can't find the container with id f155896275986a4267972c9d0ada0ccb4e9575006db6985f46e5f64387fe6e94
Oct 30 21:37:41.386519 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:41.386482    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" event={"ID":"e5235049-e55c-40f7-bc8a-ca5d63b39946","Type":"ContainerStarted","Data":"f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368"}
Oct 30 21:37:41.387058 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:41.386530    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" event={"ID":"e5235049-e55c-40f7-bc8a-ca5d63b39946","Type":"ContainerStarted","Data":"f155896275986a4267972c9d0ada0ccb4e9575006db6985f46e5f64387fe6e94"}
Oct 30 21:37:41.499029 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:41.498973    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podStartSLOduration=2.498955742 podStartE2EDuration="2.498955742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:41.498923017 +0000 UTC m=+1255.994496369" watchObservedRunningTime="2026-10-30 21:37:41.498955742 +0000 UTC m=+1255.994529098"
Oct 30 21:37:41.623136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:41.623102    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" path="/var/lib/kubelet/pods/b3788014-47c8-491d-8f92-18bf1b08c7d3/volumes"
Oct 30 21:37:42.152492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:42.152460    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:42.397985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:42.397960    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:42.410776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:42.410711    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:43.009949 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:43.009919    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:43.408965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:43.408935    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:37:43.778873 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:43.778784    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:48.535320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:48.535280    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:50.040377 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.040348    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"]
Oct 30 21:37:50.040928 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.040913    4943 cpu_manager.go:414] "containerMap: removing container" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy"
Oct 30 21:37:50.040985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.040930    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy"
Oct 30 21:37:50.040985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.040950    4943 cpu_manager.go:414] "containerMap: removing container" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy"
Oct 30 21:37:50.040985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.040955    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy"
Oct 30 21:37:50.041081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.041048    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy"
Oct 30 21:37:50.045475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.045455    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.100387 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.100352    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"]
Oct 30 21:37:50.146201 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.146169    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-021907\"/\"distinct-2-w5-021907-kserve-self-signed-certs\""
Oct 30 21:37:50.149750 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.149720    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-tmp-dir\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.149873 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.149767    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/459030a0-1766-4829-acb1-d845be102439-tls-certs\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.149923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.149867    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-model-cache\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.149967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.149923    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-home\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.150027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.150005    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-dshm\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.150086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.150074    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtslr\" (UniqueName: \"kubernetes.io/projected/459030a0-1766-4829-acb1-d845be102439-kube-api-access-mtslr\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.152396 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.152380    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:50.165274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.165256    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:50.174473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.174448    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:50.251644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.251602    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-model-cache\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.251845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.251676    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-home\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.251845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.251727    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-dshm\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.251845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.251820    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtslr\" (UniqueName: \"kubernetes.io/projected/459030a0-1766-4829-acb1-d845be102439-kube-api-access-mtslr\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.252030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.251981    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-tmp-dir\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.252030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.252019    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/459030a0-1766-4829-acb1-d845be102439-tls-certs\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.252149 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.252035    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-model-cache\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.252149 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.252103    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-home\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.252966 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.252938    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-tmp-dir\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.255264 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.255239    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/459030a0-1766-4829-acb1-d845be102439-tls-certs\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.255536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.255514    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-dshm\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.319395 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.319315    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtslr\" (UniqueName: \"kubernetes.io/projected/459030a0-1766-4829-acb1-d845be102439-kube-api-access-mtslr\") pod \"distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") " pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.358534 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.358468    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:50.485580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.483726    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:37:50.844826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:50.844789    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"]
Oct 30 21:37:50.846589 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:37:50.846518    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod459030a0_1766_4829_acb1_d845be102439.slice/crio-90752aaabaa2b7d5c63f8e3be6fdc64cdd642522350634dbcdb5ce2b90dffb6e WatchSource:0}: Error finding container 90752aaabaa2b7d5c63f8e3be6fdc64cdd642522350634dbcdb5ce2b90dffb6e: Status 404 returned error can't find the container with id 90752aaabaa2b7d5c63f8e3be6fdc64cdd642522350634dbcdb5ce2b90dffb6e
Oct 30 21:37:51.064688 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:37:51.064655    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:37:51.461348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:51.461312    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" event={"ID":"459030a0-1766-4829-acb1-d845be102439","Type":"ContainerStarted","Data":"022fb79b8743b94cd489daf718e592131026ba607593a4d3e20cd31ccfe29093"}
Oct 30 21:37:51.461585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:51.461363    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" event={"ID":"459030a0-1766-4829-acb1-d845be102439","Type":"ContainerStarted","Data":"90752aaabaa2b7d5c63f8e3be6fdc64cdd642522350634dbcdb5ce2b90dffb6e"}
Oct 30 21:37:51.579993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:51.579922    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podStartSLOduration=2.579903294 podStartE2EDuration="2.579903294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:37:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:37:51.575352906 +0000 UTC m=+1266.070926258" watchObservedRunningTime="2026-10-30 21:37:51.579903294 +0000 UTC m=+1266.075476645"
Oct 30 21:37:52.359086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:52.359036    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:37:53.288597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:53.288549    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:57.683517 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:57.683479    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:37:58.018897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:37:58.018845    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:00.359498 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:00.359466    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:38:00.372392 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:00.372364    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:38:00.530516 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:00.530483    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:38:02.695890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:02.695855    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:07.402304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:07.402268    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:12.105859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:12.105825    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:16.798831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:16.798792    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:21.065611 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:38:21.065575    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:38:21.697053 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:21.696998    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:22.560129 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.560089    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"]
Oct 30 21:38:22.560683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.560667    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3788014-47c8-491d-8f92-18bf1b08c7d3" containerName="istio-proxy"
Oct 30 21:38:22.564153 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.564130    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.615872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.615844    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-9796f1-openshift-default-dockercfg-bzdq6\""
Oct 30 21:38:22.669722 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.669693    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"]
Oct 30 21:38:22.745688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.745648    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-credential-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.745879 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.745709    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-token\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.745879 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.745745    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.745879 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.745823    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istiod-ca-cert\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.746051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.745997    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-podinfo\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.746112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.746066    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqncw\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-kube-api-access-sqncw\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.746112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.746099    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-data\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.746216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.746152    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-certs\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.746216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.746179    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-envoy\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847491    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqncw\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-kube-api-access-sqncw\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847532    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-data\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847572    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-certs\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847597    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-envoy\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847665    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-credential-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847804    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-token\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847852    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.847997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.847888    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istiod-ca-cert\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.848099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.848011    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-certs\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.848099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.848058    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-data\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.848099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.848077    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-podinfo\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.848099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.848085    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-credential-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.848298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.848258    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.848654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.848622    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istiod-ca-cert\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.850258 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.850235    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-envoy\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.850457 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.850440    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-podinfo\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.908572 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.908517    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-token\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:22.908732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:22.908675    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqncw\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-kube-api-access-sqncw\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:23.178683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:23.178655    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:23.614214 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:38:23.614184    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2fe0b31_ad26_4889_9ced_242f8121a8ce.slice/crio-37e9197c71047989d74b36a66ae08ab0721484b1f66f1a75b2e6a0f3d0da2513 WatchSource:0}: Error finding container 37e9197c71047989d74b36a66ae08ab0721484b1f66f1a75b2e6a0f3d0da2513: Status 404 returned error can't find the container with id 37e9197c71047989d74b36a66ae08ab0721484b1f66f1a75b2e6a0f3d0da2513
Oct 30 21:38:23.616773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:23.616737    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:23.616888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:23.616805    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:23.616888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:23.616832    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:23.619073 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:23.619054    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"]
Oct 30 21:38:23.682869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:23.682836    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" event={"ID":"c2fe0b31-ad26-4889-9ced-242f8121a8ce","Type":"ContainerStarted","Data":"37e9197c71047989d74b36a66ae08ab0721484b1f66f1a75b2e6a0f3d0da2513"}
Oct 30 21:38:24.692018 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:24.691980    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" event={"ID":"c2fe0b31-ad26-4889-9ced-242f8121a8ce","Type":"ContainerStarted","Data":"45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05"}
Oct 30 21:38:24.915925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:24.915863    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podStartSLOduration=2.9158499940000002 podStartE2EDuration="2.915849994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:24.864740525 +0000 UTC m=+1299.360313893" watchObservedRunningTime="2026-10-30 21:38:24.915849994 +0000 UTC m=+1299.411423416"
Oct 30 21:38:25.179764 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:25.179728    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:25.181624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:25.181596    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:25.181738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:25.181653    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:26.179030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:26.178987    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:26.179546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:26.179041    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:26.535405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:26.535327    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:27.179084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:27.179050    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:27.179515 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:27.179107    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:28.179038 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:28.178996    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:28.179247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:28.179057    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:29.180142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:29.180103    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:29.180546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:29.180171    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:30.179462 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:30.179426    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:38:30.179645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:30.179501    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:38:31.183406 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:31.183364    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:31.183849 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:31.183803    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:31.184428 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:31.184404    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:38:31.291628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:31.291597    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:36.003482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:36.003439    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:38.602181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.602145    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"]
Oct 30 21:38:38.605409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.605387    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.713795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.713754    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"]
Oct 30 21:38:38.731050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731015    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731075    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731259    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/298adac8-df56-4426-a291-6a3b1d957cda-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731400    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731437    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/298adac8-df56-4426-a291-6a3b1d957cda-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731467    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731494    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmllr\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-kube-api-access-bmllr\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731663    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.731749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.731697    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833236 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833196    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833256    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/298adac8-df56-4426-a291-6a3b1d957cda-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833334    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833361    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/298adac8-df56-4426-a291-6a3b1d957cda-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833391    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833419    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmllr\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-kube-api-access-bmllr\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833494    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833530    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833696    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833710    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.833780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.833738    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.834076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.834054    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.834202 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.834160    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/298adac8-df56-4426-a291-6a3b1d957cda-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.834361 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.834341    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.836116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.836081    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.836646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.836624    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/298adac8-df56-4426-a291-6a3b1d957cda-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.891212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.891148    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.891479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.891458    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmllr\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-kube-api-access-bmllr\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:38.918174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:38.918147    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:39.346892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.346854    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"]
Oct 30 21:38:39.348974 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:38:39.348943    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298adac8_df56_4426_a291_6a3b1d957cda.slice/crio-f732a6554b3efd315ca5bc25f2a2463b96aebf00b1f3da996be6a8abf8637663 WatchSource:0}: Error finding container f732a6554b3efd315ca5bc25f2a2463b96aebf00b1f3da996be6a8abf8637663: Status 404 returned error can't find the container with id f732a6554b3efd315ca5bc25f2a2463b96aebf00b1f3da996be6a8abf8637663
Oct 30 21:38:39.351502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.351472    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:39.351632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.351540    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:39.351685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.351626    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:39.814511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.814469    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" event={"ID":"298adac8-df56-4426-a291-6a3b1d957cda","Type":"ContainerStarted","Data":"9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d"}
Oct 30 21:38:39.815071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.814544    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" event={"ID":"298adac8-df56-4426-a291-6a3b1d957cda","Type":"ContainerStarted","Data":"f732a6554b3efd315ca5bc25f2a2463b96aebf00b1f3da996be6a8abf8637663"}
Oct 30 21:38:39.918350 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.918301    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:39.934748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:39.934696    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podStartSLOduration=1.93468116 podStartE2EDuration="1.93468116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:39.930534192 +0000 UTC m=+1314.426107586" watchObservedRunningTime="2026-10-30 21:38:39.93468116 +0000 UTC m=+1314.430254511"
Oct 30 21:38:40.920361 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:40.920316    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:40.920883 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:40.920377    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:40.946984 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:40.946879    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:41.918788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:41.918751    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:41.919059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:41.919035    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:42.919596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:42.919545    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:42.920059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:42.919619    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:43.360650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:43.360114    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:43.534885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:43.534854    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:43.918771 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:43.918740    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:43.918942 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:43.918796    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:44.919276 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:44.919235    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:44.919817 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:44.919286    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:45.840964 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:45.840929    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:45.918898 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:45.918865    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 30 21:38:45.919091 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:45.918923    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 30 21:38:46.923073 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:46.923042    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:46.923550 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:46.923315    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:46.924069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:46.924053    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:38:47.327812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.327732    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"]
Oct 30 21:38:47.332737 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.332717    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.392585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.392520    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"]
Oct 30 21:38:47.493630 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.493597    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.493814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.493648    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.493814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.493729    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.493943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.493828    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.493943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.493914    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.494026 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.493944    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.494085 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.494060    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.494124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.494095    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqnkm\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-kube-api-access-nqnkm\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.494182 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.494170    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595089    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595139    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595168    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595258    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595294    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595320    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595382    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595409    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqnkm\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-kube-api-access-nqnkm\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595485    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595585    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595619    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595746    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.595954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.595857    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.596271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.596254    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.598147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.598122    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.598323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.598306    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.652355 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.652324    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.652478 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.652405    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqnkm\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-kube-api-access-nqnkm\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:47.654241 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:47.654222    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:48.085820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:48.085788    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"]
Oct 30 21:38:48.087388 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:38:48.087354    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d04321_74c7_4770_bce8_0d4b0aaa21c4.slice/crio-24172889dd148a0454898bcf8d989802cbea31563ab7f59ff211715a377fcdae WatchSource:0}: Error finding container 24172889dd148a0454898bcf8d989802cbea31563ab7f59ff211715a377fcdae: Status 404 returned error can't find the container with id 24172889dd148a0454898bcf8d989802cbea31563ab7f59ff211715a377fcdae
Oct 30 21:38:48.090142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:48.090108    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:48.090261 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:48.090171    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:48.090261 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:48.090202    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:48.892601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:48.891182    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" event={"ID":"a5d04321-74c7-4770-bce8-0d4b0aaa21c4","Type":"ContainerStarted","Data":"823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0"}
Oct 30 21:38:48.892601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:48.891253    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" event={"ID":"a5d04321-74c7-4770-bce8-0d4b0aaa21c4","Type":"ContainerStarted","Data":"24172889dd148a0454898bcf8d989802cbea31563ab7f59ff211715a377fcdae"}
Oct 30 21:38:49.072050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:49.071985    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podStartSLOduration=2.071967049 podStartE2EDuration="2.071967049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:49.06903079 +0000 UTC m=+1323.564604143" watchObservedRunningTime="2026-10-30 21:38:49.071967049 +0000 UTC m=+1323.567540402"
Oct 30 21:38:49.658577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:49.658075    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:49.667592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:49.663654    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:38:49.667592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:49.663721    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:38:50.298598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.298542    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"]
Oct 30 21:38:50.302904 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.302877    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.399057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.399019    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"]
Oct 30 21:38:50.428945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.428901    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.429575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.429531    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.430089 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.430022    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.430307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.430275    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtd8j\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-kube-api-access-vtd8j\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.430446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.430431    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.430945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.430908    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.431133 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.431101    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7beb9e2a-8867-413d-b6b4-0c138be630ba-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.431626 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.431593    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.431952 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.431932    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533230 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533191    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533329    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533383    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtd8j\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-kube-api-access-vtd8j\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533412    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533454    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533565 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533501    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7beb9e2a-8867-413d-b6b4-0c138be630ba-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533583    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533611    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533634    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533728 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533712    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.533835 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533815    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.534008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.533994    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.534326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.534306    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.535151 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.535123    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7beb9e2a-8867-413d-b6b4-0c138be630ba-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.536426 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.536405    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.536799 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.536783    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.595418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.595350    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.598118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.598094    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtd8j\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-kube-api-access-vtd8j\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.621044 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.620428    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:50.669578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.657079    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:38:50.669578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.657133    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:38:50.715412 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:50.715384    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:51.086320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.086292    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"]
Oct 30 21:38:51.087019 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:38:51.086991    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7beb9e2a_8867_413d_b6b4_0c138be630ba.slice/crio-d2dedd2fd764f20a99599dfa422172d6e4564788f30fe4b29e13cbb9140d9843 WatchSource:0}: Error finding container d2dedd2fd764f20a99599dfa422172d6e4564788f30fe4b29e13cbb9140d9843: Status 404 returned error can't find the container with id d2dedd2fd764f20a99599dfa422172d6e4564788f30fe4b29e13cbb9140d9843
Oct 30 21:38:51.089925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.089887    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:51.090003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.089973    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:51.090056 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.090017    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:38:51.090315 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:38:51.090292    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:38:51.667577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.663703    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:38:51.667577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.663796    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:38:51.913014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.912983    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" event={"ID":"7beb9e2a-8867-413d-b6b4-0c138be630ba","Type":"ContainerStarted","Data":"149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0"}
Oct 30 21:38:51.913569 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:51.913038    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" event={"ID":"7beb9e2a-8867-413d-b6b4-0c138be630ba","Type":"ContainerStarted","Data":"d2dedd2fd764f20a99599dfa422172d6e4564788f30fe4b29e13cbb9140d9843"}
Oct 30 21:38:52.039365 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:52.039269    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podStartSLOduration=2.039252882 podStartE2EDuration="2.039252882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:52.037821435 +0000 UTC m=+1326.533394785" watchObservedRunningTime="2026-10-30 21:38:52.039252882 +0000 UTC m=+1326.534826233"
Oct 30 21:38:52.621570 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:52.621527    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:52.622972 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:52.622951    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:38:52.623071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:52.622996    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:38:52.662580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:52.661924    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:38:52.662580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:52.661985    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:38:53.621378 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:53.621342    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:38:53.621796 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:53.621395    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:38:53.659578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:53.658939    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:38:53.659578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:53.658996    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:38:54.621110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:54.621072    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:38:54.621288 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:54.621136    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:38:54.666578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:54.665887    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Oct 30 21:38:54.666578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:54.665947    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Oct 30 21:38:55.621577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:55.621528    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:38:55.621756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:55.621603    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:38:55.795591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:55.790140    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:38:56.179189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:56.178899    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:56.179863 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:56.179840    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:56.181042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:56.181024    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:38:56.621767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:56.621690    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:38:56.621767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:56.621743    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:38:57.542195 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.542161    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"]
Oct 30 21:38:57.547066 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.547046    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.593822 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.593783    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.593998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.593942    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72llg\" (UniqueName: \"kubernetes.io/projected/5feef019-756c-496c-b0bf-efb12fc31596-kube-api-access-72llg\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.594080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.594002    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.606276 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.606249    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"]
Oct 30 21:38:57.621619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.621588    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 30 21:38:57.621749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.621650    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 30 21:38:57.647431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.647399    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 21:38:57.647893 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.647448    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6t2c7\""
Oct 30 21:38:57.695682 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.695646    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.695824 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.695707    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72llg\" (UniqueName: \"kubernetes.io/projected/5feef019-756c-496c-b0bf-efb12fc31596-kube-api-access-72llg\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.695824 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.695791    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.696351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.696323    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.698159 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.698137    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.754625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.754592    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72llg\" (UniqueName: \"kubernetes.io/projected/5feef019-756c-496c-b0bf-efb12fc31596-kube-api-access-72llg\") pod \"maas-api-revoke-sub-d7a88777-m9v7t\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:57.861088 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:57.861004    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:38:58.241063 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:58.241035    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"]
Oct 30 21:38:58.242799 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:38:58.242770    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5feef019_756c_496c_b0bf_efb12fc31596.slice/crio-f1f785a33b666314d8f5c9f45cb18b5864d7fb9ec212673d5ace083492ae73e7 WatchSource:0}: Error finding container f1f785a33b666314d8f5c9f45cb18b5864d7fb9ec212673d5ace083492ae73e7: Status 404 returned error can't find the container with id f1f785a33b666314d8f5c9f45cb18b5864d7fb9ec212673d5ace083492ae73e7
Oct 30 21:38:58.627540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:58.627506    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:58.627921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:58.627809    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:58.628528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:58.628509    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:38:58.981076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:58.981037    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t" event={"ID":"5feef019-756c-496c-b0bf-efb12fc31596","Type":"ContainerStarted","Data":"889571a2b770d00e0b0e003c720b6062d1a5e61ef78046c3ad35aff1d93ee95f"}
Oct 30 21:38:58.981388 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:58.981092    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t" event={"ID":"5feef019-756c-496c-b0bf-efb12fc31596","Type":"ContainerStarted","Data":"f1f785a33b666314d8f5c9f45cb18b5864d7fb9ec212673d5ace083492ae73e7"}
Oct 30 21:38:59.097627 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:59.097534    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t" podStartSLOduration=2.09751764 podStartE2EDuration="2.09751764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:38:59.094449675 +0000 UTC m=+1333.590023026" watchObservedRunningTime="2026-10-30 21:38:59.09751764 +0000 UTC m=+1333.593090991"
Oct 30 21:38:59.989362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:59.989330    4943 generic.go:356] "Generic (PLEG): container finished" podID="5feef019-756c-496c-b0bf-efb12fc31596" containerID="889571a2b770d00e0b0e003c720b6062d1a5e61ef78046c3ad35aff1d93ee95f" exitCode=0
Oct 30 21:38:59.989855 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:38:59.989412    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t" event={"ID":"5feef019-756c-496c-b0bf-efb12fc31596","Type":"ContainerDied","Data":"889571a2b770d00e0b0e003c720b6062d1a5e61ef78046c3ad35aff1d93ee95f"}
Oct 30 21:39:00.593477 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:00.593428    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:01.150959 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.150935    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:39:01.236013 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.235985    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-openshift-ca\") pod \"5feef019-756c-496c-b0bf-efb12fc31596\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") "
Oct 30 21:39:01.236170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.236031    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-xks-ca\") pod \"5feef019-756c-496c-b0bf-efb12fc31596\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") "
Oct 30 21:39:01.236170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.236110    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5feef019-756c-496c-b0bf-efb12fc31596-kube-api-access-72llg\" (UniqueName: \"kubernetes.io/projected/5feef019-756c-496c-b0bf-efb12fc31596-kube-api-access-72llg\") pod \"5feef019-756c-496c-b0bf-efb12fc31596\" (UID: \"5feef019-756c-496c-b0bf-efb12fc31596\") "
Oct 30 21:39:01.236372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.236347    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-openshift-ca" pod "5feef019-756c-496c-b0bf-efb12fc31596" (UID: "5feef019-756c-496c-b0bf-efb12fc31596"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:39:01.236546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.236530    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-openshift-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:39:01.237995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.237976    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-xks-ca" pod "5feef019-756c-496c-b0bf-efb12fc31596" (UID: "5feef019-756c-496c-b0bf-efb12fc31596"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:39:01.238115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.238099    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5feef019-756c-496c-b0bf-efb12fc31596-kube-api-access-72llg" pod "5feef019-756c-496c-b0bf-efb12fc31596" (UID: "5feef019-756c-496c-b0bf-efb12fc31596"). InnerVolumeSpecName "kube-api-access-72llg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:39:01.338389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.338302    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/5feef019-756c-496c-b0bf-efb12fc31596-maas-api-xks-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:39:01.338389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:01.338334    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72llg\" (UniqueName: \"kubernetes.io/projected/5feef019-756c-496c-b0bf-efb12fc31596-kube-api-access-72llg\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:39:02.004019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:02.003983    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"
Oct 30 21:39:02.004197 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:02.004016    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t" event={"ID":"5feef019-756c-496c-b0bf-efb12fc31596","Type":"ContainerDied","Data":"f1f785a33b666314d8f5c9f45cb18b5864d7fb9ec212673d5ace083492ae73e7"}
Oct 30 21:39:02.004197 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:02.004076    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1f785a33b666314d8f5c9f45cb18b5864d7fb9ec212673d5ace083492ae73e7"
Oct 30 21:39:05.295665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:05.295623    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:08.277463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.277414    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"]
Oct 30 21:39:08.278261 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.278239    4943 cpu_manager.go:414] "containerMap: removing container" podUID="5feef019-756c-496c-b0bf-efb12fc31596" containerName="revoke-keys"
Oct 30 21:39:08.278347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.278262    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5feef019-756c-496c-b0bf-efb12fc31596" containerName="revoke-keys"
Oct 30 21:39:08.278453 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.278440    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="5feef019-756c-496c-b0bf-efb12fc31596" containerName="revoke-keys"
Oct 30 21:39:08.282131 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.282109    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.325940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.325913    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"]
Oct 30 21:39:08.329712 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.329692    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.377324 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.377288    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"]
Oct 30 21:39:08.395448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.395421    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"]
Oct 30 21:39:08.420484 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420449    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.420657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420498    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.420657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420617    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.420784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420662    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.420784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420689    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6dac656-a08e-40ff-8671-0474c7652d40-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.420784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420737    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.420942 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420872    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4mn4\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-kube-api-access-b4mn4\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.421003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.420940    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.421062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421009    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.421062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421042    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.421169 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421092    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htl9m\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-kube-api-access-htl9m\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.421221 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421179    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8f319b-25f0-456a-86e4-d7578c5a244b-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.421274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421217    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.421274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421246    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.421384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421322    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.421384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421373    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6dac656-a08e-40ff-8671-0474c7652d40-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.421492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421420    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.421492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.421453    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.522967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.522940    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.522976    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.522997    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.523144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523028    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htl9m\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-kube-api-access-htl9m\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523051    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8f319b-25f0-456a-86e4-d7578c5a244b-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.523144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523070    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.523144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523087    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523123    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523166    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6dac656-a08e-40ff-8671-0474c7652d40-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523211    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523243    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523339    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523363    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523397    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523405    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523455    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523484    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6dac656-a08e-40ff-8671-0474c7652d40-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.523513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523510    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.524017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523544    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.524017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523578    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.524017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523871    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8f319b-25f0-456a-86e4-d7578c5a244b-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.524017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.523971    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.524212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.524127    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-data\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.524389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.524357    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.524691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.524665    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-credential-socket\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.524947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.524924    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-certs\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.525073 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.524965    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6dac656-a08e-40ff-8671-0474c7652d40-istiod-ca-cert\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.525073 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.525037    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4mn4\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-kube-api-access-b4mn4\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.526164 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.526137    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.526283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.526194    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.526510 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.526486    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6dac656-a08e-40ff-8671-0474c7652d40-istio-podinfo\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.526704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.526688    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-envoy\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.582627 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.582541    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.582739 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.582693    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htl9m\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-kube-api-access-htl9m\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:08.583003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.582982    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4mn4\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-kube-api-access-b4mn4\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.584856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.584839    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-token\") pod \"e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") " pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.597854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.597833    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:08.650993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:08.650735    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:09.029199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.029169    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"]
Oct 30 21:39:09.030459 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:39:09.030434    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8f319b_25f0_456a_86e4_d7578c5a244b.slice/crio-f637375743d245602591bd7e835c0590da38e7318aa6e7ea3762588b4085c80f WatchSource:0}: Error finding container f637375743d245602591bd7e835c0590da38e7318aa6e7ea3762588b4085c80f: Status 404 returned error can't find the container with id f637375743d245602591bd7e835c0590da38e7318aa6e7ea3762588b4085c80f
Oct 30 21:39:09.032800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.032770    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:09.032880 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.032843    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:09.032918 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.032877    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:09.053825 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.053790    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" event={"ID":"2d8f319b-25f0-456a-86e4-d7578c5a244b","Type":"ContainerStarted","Data":"f637375743d245602591bd7e835c0590da38e7318aa6e7ea3762588b4085c80f"}
Oct 30 21:39:09.083442 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.083415    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"]
Oct 30 21:39:09.086919 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:39:09.086893    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6dac656_a08e_40ff_8671_0474c7652d40.slice/crio-57ad458fbdfed1c3151b1076fa1e731839814f9bddb762ed14ce13d3546676c6 WatchSource:0}: Error finding container 57ad458fbdfed1c3151b1076fa1e731839814f9bddb762ed14ce13d3546676c6: Status 404 returned error can't find the container with id 57ad458fbdfed1c3151b1076fa1e731839814f9bddb762ed14ce13d3546676c6
Oct 30 21:39:09.089981 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.089951    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:09.090068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.090037    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:09.090112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:09.090101    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:10.089636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.087041    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" event={"ID":"e6dac656-a08e-40ff-8671-0474c7652d40","Type":"ContainerStarted","Data":"41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9"}
Oct 30 21:39:10.089636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.087115    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" event={"ID":"e6dac656-a08e-40ff-8671-0474c7652d40","Type":"ContainerStarted","Data":"57ad458fbdfed1c3151b1076fa1e731839814f9bddb762ed14ce13d3546676c6"}
Oct 30 21:39:10.114581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.106335    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" event={"ID":"2d8f319b-25f0-456a-86e4-d7578c5a244b","Type":"ContainerStarted","Data":"1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101"}
Oct 30 21:39:10.127607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.126471    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:10.272579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.271821    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podStartSLOduration=2.271799797 podStartE2EDuration="2.271799797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:10.270593471 +0000 UTC m=+1344.766166819" watchObservedRunningTime="2026-10-30 21:39:10.271799797 +0000 UTC m=+1344.767373152"
Oct 30 21:39:10.397634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.397500    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podStartSLOduration=2.397479591 podStartE2EDuration="2.397479591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:10.394975711 +0000 UTC m=+1344.890549062" watchObservedRunningTime="2026-10-30 21:39:10.397479591 +0000 UTC m=+1344.893052943"
Oct 30 21:39:10.613375 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.613336    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:10.615321 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.615284    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:10.615528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.615503    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:10.673676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.656205    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:10.673676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.656336    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:10.673676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:10.656380    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:11.600577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:11.599971    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:11.600577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:11.600037    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:11.664578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:11.664423    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:11.664578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:11.664481    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:12.404581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:12.404188    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:12.588580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:12.587824    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:12.598926 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:12.598891    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:12.599104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:12.598965    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:12.660634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:12.654999    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:12.660634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:12.655075    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:13.600311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:13.600264    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:13.600495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:13.600350    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:13.669581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:13.665917    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:13.669581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:13.665974    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:14.599955 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:14.599917    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:14.600632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:14.599993    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:14.660581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:14.658549    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:14.660581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:14.658625    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:15.313063 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.313012    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:15.416827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.416770    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:15.474580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.464707    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:15.474580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.470628    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:15.480813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.480736    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:15.599216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.599116    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:15.599486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.599455    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:15.663173 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.663134    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:15.663462 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.663429    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:15.680435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.680312    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:15.863632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.860643    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 21:39:15.974147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.974108    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:15.986691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:15.986646    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:16.275144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.275105    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:16.320982 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.320928    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:16.329997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.329955    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:39:16.392199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.392159    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:16.393917 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.393828    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:16.465581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.419611    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:39:16.482674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.466935    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:16.520594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.495718    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 21:39:16.520594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.499602    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:39:16.520594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.505751    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:39:16.520594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.505907    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:39:16.559636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.545959    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:39:16.622135 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.601541    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:16.622135 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.601646    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:16.654532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.654496    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:16.658662 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.658620    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:16.869633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.866420    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:16.869633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.867815    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:39:16.987774 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.987732    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:16.989269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:16.989104    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:39:17.246441 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.246406    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:17.246766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.246718    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:17.340213 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.340167    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:39:17.489993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.489283    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:17.490843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.490281    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:39:17.497110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.496988    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:17.546243 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.546201    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:39:17.546850 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.546827    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:39:17.634721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.634687    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:17.635004 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.634971    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:17.665731 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.665695    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:17.666018 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.665987    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:17.867603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:17.867486    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.004684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.004646    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:18.004940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.004912    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.011064 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.010636    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.312070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.308860    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:39:18.312070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.310366    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.561307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.561258    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.562265 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.562193    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:39:18.588063 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.565920    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.588617 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.566507    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:39:18.611575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.566603    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.624578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.612609    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:18.655612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.651872    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:18.655612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.651935    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:18.726759 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.726646    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:18.875530 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.875431    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:19.010581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:18.625832    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:19.035582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.020141    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:19.284597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.283023    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:39:19.356720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.356676    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:19.357335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.357307    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:39:19.435183 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.435150    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:39:19.471211 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.471181    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:39:19.471490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.471473    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:39:19.489735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.489712    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:39:19.490226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.490208    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:39:19.502261 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.502239    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:39:19.594292 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.594196    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 21:39:19.610313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.610280    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Oct 30 21:39:19.610598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.610566    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Oct 30 21:39:19.678204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.678171    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 30 21:39:19.678491 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.678462    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 30 21:39:19.908105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:19.908074    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:39:21.099586 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:39:21.096230    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:39:21.640689 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:21.640657    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:21.640839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:21.640707    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:21.696586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:21.695809    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:21.696586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:21.695862    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:21.811516 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:21.811471    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:22.214126 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:22.214097    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:22.214682 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:22.214658    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:22.215433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:22.215411    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:39:22.372046 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:22.372015    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:22.372462 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:22.372439    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:22.373422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:22.373404    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:39:23.692707 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.692673    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"]
Oct 30 21:39:23.698165 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.698141    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.748649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.748611    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.748976    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.749025    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeced95a-8f11-4aba-8ab6-82a6288b836b-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749165 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.749120    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvhvv\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-kube-api-access-xvhvv\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.749166    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749279 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.749258    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749328 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.749305    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.749365    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.749470 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.749455    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.804747 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.804717    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"]
Oct 30 21:39:23.850228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850201    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850348    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850391    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeced95a-8f11-4aba-8ab6-82a6288b836b-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850423    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvhvv\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-kube-api-access-xvhvv\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850453    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850600    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850660    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850700    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850781    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.850920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.850900    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.851172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.851152    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.851251 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.851191    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeced95a-8f11-4aba-8ab6-82a6288b836b-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.851313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.851245    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.851509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.851488    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.852933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.852911    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.853015 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.852944    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.907123 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.907096    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:23.907327 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:23.907305    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvhvv\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-kube-api-access-xvhvv\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:24.011948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:24.011872    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:24.452692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:24.452660    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"]
Oct 30 21:39:24.452810 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:39:24.452745    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeced95a_8f11_4aba_8ab6_82a6288b836b.slice/crio-3e2b23b9d1252c9edddd178b57124e0a19fcd3fa31d29d51acf2a26e776f567c WatchSource:0}: Error finding container 3e2b23b9d1252c9edddd178b57124e0a19fcd3fa31d29d51acf2a26e776f567c: Status 404 returned error can't find the container with id 3e2b23b9d1252c9edddd178b57124e0a19fcd3fa31d29d51acf2a26e776f567c
Oct 30 21:39:24.455496 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:24.455468    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:24.455607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:24.455530    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:24.455607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:24.455576    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:25.063254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:25.063212    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" event={"ID":"eeced95a-8f11-4aba-8ab6-82a6288b836b","Type":"ContainerStarted","Data":"606cb9cff15ea093d1ea1da8517a87dc08b377c279fe61c8da9cfa22ea6a1124"}
Oct 30 21:39:25.063681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:25.063278    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" event={"ID":"eeced95a-8f11-4aba-8ab6-82a6288b836b","Type":"ContainerStarted","Data":"3e2b23b9d1252c9edddd178b57124e0a19fcd3fa31d29d51acf2a26e776f567c"}
Oct 30 21:39:25.231165 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:25.231090    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podStartSLOduration=2.231069871 podStartE2EDuration="2.231069871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:25.228163291 +0000 UTC m=+1359.723736667" watchObservedRunningTime="2026-10-30 21:39:25.231069871 +0000 UTC m=+1359.726643224"
Oct 30 21:39:26.012983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:26.012944    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:26.014937 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:26.014911    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:39:26.015055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:26.014982    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:39:26.689533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:26.689484    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:27.012359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:27.012275    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:39:27.012359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:27.012335    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:39:28.013094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:28.013062    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:39:28.013485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:28.013128    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:39:29.013023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:29.012990    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:39:29.013200 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:29.013052    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:39:30.013104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:30.013068    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:39:30.013279 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:30.013121    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:39:31.012460 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:31.012419    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:39:31.012662 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:31.012488    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:39:31.498377 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:31.498340    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:32.016210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.016179    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:32.016678 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.016653    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:32.017509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.017484    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:39:32.736890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.736860    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"]
Oct 30 21:39:32.741631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.741602    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.823364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.823334    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"]
Oct 30 21:39:32.875010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.874971    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875162 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875022    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875179    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4184a596-8abd-4833-8733-021d3d3a2106-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875233    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875339 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875321    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4184a596-8abd-4833-8733-021d3d3a2106-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875434 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875412    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875478    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcr7x\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-kube-api-access-vcr7x\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875546    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.875642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.875628    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977099    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4184a596-8abd-4833-8733-021d3d3a2106-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977181    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977220    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4184a596-8abd-4833-8733-021d3d3a2106-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977268    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977296    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcr7x\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-kube-api-access-vcr7x\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977360    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977396    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977446    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977469    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977700    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-data\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.977844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.977824    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-credential-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.978221 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.978151    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4184a596-8abd-4833-8733-021d3d3a2106-istiod-ca-cert\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.978326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.978267    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-socket\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.978326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.978288    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-certs\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.980415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.980394    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-envoy\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:32.980778 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:32.980761    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4184a596-8abd-4833-8733-021d3d3a2106-istio-podinfo\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:33.037108 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:33.037032    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-istio-token\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:33.037433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:33.037414    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcr7x\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-kube-api-access-vcr7x\") pod \"e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") " pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:33.056232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:33.056209    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:33.495133 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:33.494692    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"]
Oct 30 21:39:33.496427 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:39:33.496396    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4184a596_8abd_4833_8733_021d3d3a2106.slice/crio-3406ffa3a941bc527299cb87319ff22b50771a85cc307ba3a036805ba37b4882 WatchSource:0}: Error finding container 3406ffa3a941bc527299cb87319ff22b50771a85cc307ba3a036805ba37b4882: Status 404 returned error can't find the container with id 3406ffa3a941bc527299cb87319ff22b50771a85cc307ba3a036805ba37b4882
Oct 30 21:39:33.499448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:33.499414    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:33.499546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:33.499477    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:33.499546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:33.499533    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:34.165607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:34.165171    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" event={"ID":"4184a596-8abd-4833-8733-021d3d3a2106","Type":"ContainerStarted","Data":"fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b"}
Oct 30 21:39:34.165607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:34.165242    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" event={"ID":"4184a596-8abd-4833-8733-021d3d3a2106","Type":"ContainerStarted","Data":"3406ffa3a941bc527299cb87319ff22b50771a85cc307ba3a036805ba37b4882"}
Oct 30 21:39:34.287370 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:34.287310    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podStartSLOduration=2.287294339 podStartE2EDuration="2.287294339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:34.285476075 +0000 UTC m=+1368.781049424" watchObservedRunningTime="2026-10-30 21:39:34.287294339 +0000 UTC m=+1368.782867689"
Oct 30 21:39:35.070581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.067614    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:35.070581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.068676    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:39:35.070581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.068729    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:39:35.693531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.693490    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"]
Oct 30 21:39:35.697988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.697967    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.784872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.784809    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"]
Oct 30 21:39:35.815306 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.815263    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.815683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.815648    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15376a9c-2cf0-402e-af11-158fa71738de-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.815813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.815714    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.815883 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.815778    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.815938 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.815919    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.815993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.815946    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.815993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.815975    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.816092 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.816053    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15376a9c-2cf0-402e-af11-158fa71738de-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.816186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.816170    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-kube-api-access-bpj5f\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.917533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917493    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.917758 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917540    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.917758 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917606    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.917758 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917689    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15376a9c-2cf0-402e-af11-158fa71738de-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917810    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-kube-api-access-bpj5f\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917855    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917925    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15376a9c-2cf0-402e-af11-158fa71738de-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.917977    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.918005    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918383 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.918231    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.918653    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15376a9c-2cf0-402e-af11-158fa71738de-istiod-ca-cert\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.918809    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-certs\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.918951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.918928    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-credential-socket\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.919049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.919035    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-data\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.920484 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.920459    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-envoy\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.920841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.920597    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15376a9c-2cf0-402e-af11-158fa71738de-istio-podinfo\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.978364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.978302    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-kube-api-access-bpj5f\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:35.979422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:35.979397    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-istio-token\") pod \"e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") " pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:36.012502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.012477    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:36.075580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.062917    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:39:36.075580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.062972    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:39:36.340232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.340133    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:36.479623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.479595    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"]
Oct 30 21:39:36.481284 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:39:36.481252    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15376a9c_2cf0_402e_af11_158fa71738de.slice/crio-34932bda0969d557f4a9d645e227a5f6d7cb91fe7a012d883b6bc2def1ed765b WatchSource:0}: Error finding container 34932bda0969d557f4a9d645e227a5f6d7cb91fe7a012d883b6bc2def1ed765b: Status 404 returned error can't find the container with id 34932bda0969d557f4a9d645e227a5f6d7cb91fe7a012d883b6bc2def1ed765b
Oct 30 21:39:36.483823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.483793    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:36.483887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.483855    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:36.483923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:36.483886    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:37.058692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:37.058656    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:39:37.059323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:37.059287    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:39:37.204195 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:37.204158    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" event={"ID":"15376a9c-2cf0-402e-af11-158fa71738de","Type":"ContainerStarted","Data":"8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80"}
Oct 30 21:39:37.204447 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:37.204427    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" event={"ID":"15376a9c-2cf0-402e-af11-158fa71738de","Type":"ContainerStarted","Data":"34932bda0969d557f4a9d645e227a5f6d7cb91fe7a012d883b6bc2def1ed765b"}
Oct 30 21:39:37.334642 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:37.334313    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podStartSLOduration=2.334299095 podStartE2EDuration="2.334299095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:37.333941629 +0000 UTC m=+1371.829514982" watchObservedRunningTime="2026-10-30 21:39:37.334299095 +0000 UTC m=+1371.829872445"
Oct 30 21:39:38.013493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:38.012938    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:38.014454 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:38.014432    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:39:38.014515 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:38.014479    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:39:38.065578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:38.064906    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:39:38.065578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:38.064967    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:39:39.013440 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.013404    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:39:39.013644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.013471    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:39:39.106950 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.106908    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:39:39.107433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.106984    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:39:39.109035 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.108986    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"]
Oct 30 21:39:39.114741 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.114719    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.211764 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.211726    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"]
Oct 30 21:39:39.211943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.211858    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.211943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.211926    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.212242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.211968    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.212242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.212054    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m9gl\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-kube-api-access-2m9gl\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.212242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.212086    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6885f882-ff36-4663-ae23-15ce669a5a04-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.212242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.212131    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.212543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.212229    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6885f882-ff36-4663-ae23-15ce669a5a04-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.212543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.212439    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.212683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.212646    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314249 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314163    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314249 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314233    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314301    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m9gl\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-kube-api-access-2m9gl\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314331    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6885f882-ff36-4663-ae23-15ce669a5a04-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314377    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314448    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6885f882-ff36-4663-ae23-15ce669a5a04-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314478    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314503    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314773 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314604    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.314906 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.314887    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6885f882-ff36-4663-ae23-15ce669a5a04-istiod-ca-cert\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.315113 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.315087    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-credential-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.315224 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.315203    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-data\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.315431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.315408    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-socket\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.315535 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.315480    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-certs\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.317289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.317268    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6885f882-ff36-4663-ae23-15ce669a5a04-istio-podinfo\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.318007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.317980    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-envoy\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.380577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.378112    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-istio-token\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.391722 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.389336    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m9gl\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-kube-api-access-2m9gl\") pod \"e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") " pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.428706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.428674    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:39.966579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.964811    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"]
Oct 30 21:39:39.972808 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.972769    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:39.972996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.972978    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:39.973120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:39.973106    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:40.013659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.013636    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:39:40.013776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.013683    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:39:40.060820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.060711    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body=
Oct 30 21:39:40.060820 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.060763    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused"
Oct 30 21:39:40.241283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.241199    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" event={"ID":"6885f882-ff36-4663-ae23-15ce669a5a04","Type":"ContainerStarted","Data":"13abe1c9c43a4ee145e08e1fdbd03de4986671c0d1da69d8d30c01406e6ab4a8"}
Oct 30 21:39:40.241283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.241261    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" event={"ID":"6885f882-ff36-4663-ae23-15ce669a5a04","Type":"ContainerStarted","Data":"8eb9aacd46b8404c48f80e6fd2cdf4d2d04038599a2e5ebd35738c702b0aa451"}
Oct 30 21:39:40.371577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.371330    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podStartSLOduration=1.371309767 podStartE2EDuration="1.371309767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:40.364937921 +0000 UTC m=+1374.860511282" watchObservedRunningTime="2026-10-30 21:39:40.371309767 +0000 UTC m=+1374.866883122"
Oct 30 21:39:40.429883 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:40.429824    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:41.038598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.037657    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:39:41.038598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.037722    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:39:41.432110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.432075    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:39:41.432614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.432133    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:39:41.514919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.514886    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:41.516316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.516294    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:41.517246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.517208    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:39:41.541031 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:41.540993    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:42.013169 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:42.013138    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:39:42.013390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:42.013366    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:39:42.429709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:42.429672    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:39:42.429909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:42.429730    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:39:43.013387 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:43.013253    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 30 21:39:43.013387 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:43.013311    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 30 21:39:43.429450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:43.429418    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:39:43.429647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:43.429470    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:39:43.789267 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:43.789167    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:44.333030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:44.332972    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:44.333593 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:44.333549    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:44.334716 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:44.334695    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:39:44.429928 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:44.429897    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:39:44.430102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:44.429946    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:39:45.429799 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:45.429769    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:39:45.430187 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:45.429819    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:39:46.129196 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.129162    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7298-5db199"]
Oct 30 21:39:46.135010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.134982    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:39:46.184115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.184081    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjj6q\" (UniqueName: \"kubernetes.io/projected/62ce8ad2-38d5-466d-9ebb-215327b1d2d4-kube-api-access-zjj6q\") pod \"test-curl-7298-5db199\" (UID: \"62ce8ad2-38d5-466d-9ebb-215327b1d2d4\") " pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:39:46.188216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.188190    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7298-5db199"]
Oct 30 21:39:46.231865 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.231832    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m2hp5\""
Oct 30 21:39:46.285094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.285056    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjj6q\" (UniqueName: \"kubernetes.io/projected/62ce8ad2-38d5-466d-9ebb-215327b1d2d4-kube-api-access-zjj6q\") pod \"test-curl-7298-5db199\" (UID: \"62ce8ad2-38d5-466d-9ebb-215327b1d2d4\") " pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:39:46.353162 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.353126    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjj6q\" (UniqueName: \"kubernetes.io/projected/62ce8ad2-38d5-466d-9ebb-215327b1d2d4-kube-api-access-zjj6q\") pod \"test-curl-7298-5db199\" (UID: \"62ce8ad2-38d5-466d-9ebb-215327b1d2d4\") " pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:39:46.429745 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.429714    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body=
Oct 30 21:39:46.429907 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.429774    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused"
Oct 30 21:39:46.441086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.441051    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:46.477449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.477407    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:39:46.898197 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.898174    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7298-5db199"]
Oct 30 21:39:46.900643 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:39:46.900609    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62ce8ad2_38d5_466d_9ebb_215327b1d2d4.slice/crio-349569c480bd836bf94c181dad9eb6380adf4c8e41f128da51aff50f459db36b WatchSource:0}: Error finding container 349569c480bd836bf94c181dad9eb6380adf4c8e41f128da51aff50f459db36b: Status 404 returned error can't find the container with id 349569c480bd836bf94c181dad9eb6380adf4c8e41f128da51aff50f459db36b
Oct 30 21:39:46.902659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:46.902635    4943 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:39:47.415147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:47.415107    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7298-5db199" event={"ID":"62ce8ad2-38d5-466d-9ebb-215327b1d2d4","Type":"ContainerStarted","Data":"349569c480bd836bf94c181dad9eb6380adf4c8e41f128da51aff50f459db36b"}
Oct 30 21:39:47.686630 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:47.685853    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:47.687108 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:47.686747    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:47.687806 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:47.687780    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:39:48.173493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.173447    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"]
Oct 30 21:39:48.178104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.178078    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.213818 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.213789    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.213967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.213832    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.213967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.213861    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prwn6\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-kube-api-access-prwn6\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.214100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.214008    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.214100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.214039    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.214204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.214130    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.214204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.214183    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.214311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.214281    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.214311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.214302    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.236708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.236681    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"]
Oct 30 21:39:48.316036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.315996    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316063    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316115    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316185    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316203    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316276    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316308    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316325    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prwn6\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-kube-api-access-prwn6\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316376    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316523    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316637    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.316767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.316727    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.317076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.317056    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.317418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.317401    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.318893 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.318874    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.319785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.319763    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.373574 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.372954    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.373574 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.373352    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prwn6\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-kube-api-access-prwn6\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.498418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.498324    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:48.942291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.942258    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"]
Oct 30 21:39:48.991252 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:39:48.991207    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6bdcec_56f6_4690_9dba_b44e5ec73a62.slice/crio-4a21462eb841ab6d10d25b9196ba3fc7a7ea62130ee5bfb73b1bf5b065f6d319 WatchSource:0}: Error finding container 4a21462eb841ab6d10d25b9196ba3fc7a7ea62130ee5bfb73b1bf5b065f6d319: Status 404 returned error can't find the container with id 4a21462eb841ab6d10d25b9196ba3fc7a7ea62130ee5bfb73b1bf5b065f6d319
Oct 30 21:39:48.997229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.997183    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:48.997330 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.997276    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:48.997330 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:48.997322    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:49.435220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:49.434852    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" event={"ID":"bc6bdcec-56f6-4690-9dba-b44e5ec73a62","Type":"ContainerStarted","Data":"22bf9e6a7b372eb396d420b767a9a1758f38007d4278fa253c40c253439c3de9"}
Oct 30 21:39:49.435220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:49.434918    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" event={"ID":"bc6bdcec-56f6-4690-9dba-b44e5ec73a62","Type":"ContainerStarted","Data":"4a21462eb841ab6d10d25b9196ba3fc7a7ea62130ee5bfb73b1bf5b065f6d319"}
Oct 30 21:39:49.498658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:49.498616    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:39:49.649703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:49.649655    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podStartSLOduration=1.649641205 podStartE2EDuration="1.649641205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:49.599521453 +0000 UTC m=+1384.095094803" watchObservedRunningTime="2026-10-30 21:39:49.649641205 +0000 UTC m=+1384.145214552"
Oct 30 21:39:50.480445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:50.480402    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7298-5db199" event={"ID":"62ce8ad2-38d5-466d-9ebb-215327b1d2d4","Type":"ContainerStarted","Data":"c75f7251e318ce7237e95066da143e719c10896707e4407f5adbfa36bf1c9593"}
Oct 30 21:39:50.501119 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:50.501080    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:50.501331 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:50.501145    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:50.594731 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:50.594233    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7298-5db199" podStartSLOduration=1.559186016 podStartE2EDuration="4.594214895s" totalImagesPullingTime="3.035028879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:50.593702639 +0000 UTC m=+1385.089276011" watchObservedRunningTime="2026-10-30 21:39:50.594214895 +0000 UTC m=+1385.089788246"
Oct 30 21:39:51.086610 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:39:51.086522    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:39:51.499695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:51.498861    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:51.499695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:51.498925    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:52.508590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:52.502674    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:52.508590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:52.502730    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:52.670590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:52.667393    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:39:53.270082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.270039    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"]
Oct 30 21:39:53.274984 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.274963    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.319470 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.319438    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-data\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.319681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.319506    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.319681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.319667    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-credential-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.319802 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.319693    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhsxf\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-kube-api-access-rhsxf\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.319802 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.319721    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-envoy\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.319909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.319877    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-certs\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.319966 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.319959    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0935e2-78eb-4ed0-a007-84763f3fd807-istiod-ca-cert\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.320051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.320038    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-podinfo\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.320116 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.320104    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-token\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.361572 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.360620    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"]
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469007    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-podinfo\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469121    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-token\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469160    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-data\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469206    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469287    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-credential-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469313    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhsxf\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-kube-api-access-rhsxf\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469349    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-envoy\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469411    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-certs\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.469492    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0935e2-78eb-4ed0-a007-84763f3fd807-istiod-ca-cert\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.470413    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0935e2-78eb-4ed0-a007-84763f3fd807-istiod-ca-cert\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.471748    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-credential-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.472284    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-data\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.472580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.472492    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-socket\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.473294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.473156    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-certs\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.505576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.505238    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-podinfo\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.516089 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.509391    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:53.516089 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.509442    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:53.537729 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.537649    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-envoy\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.587588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.580117    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-token\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.588431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.588374    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhsxf\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-kube-api-access-rhsxf\") pod \"e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") " pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:53.596622 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:53.589782    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:54.763638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:54.735118    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:54.763638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:54.759688    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:55.093650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.065774    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"]
Oct 30 21:39:55.143160 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.143114    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:55.174681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.174540    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:55.175236 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.175205    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:39:55.516320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.516271    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:55.537381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.537334    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:55.684578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.679637    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.684578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.683627    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.690577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.685438    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.731731 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.731684    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.746238 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.746185    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.746589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.746534    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.759818 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.759629    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.760445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.760410    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:39:55.894481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.893669    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:55.936648 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.925112    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" event={"ID":"0f0935e2-78eb-4ed0-a007-84763f3fd807","Type":"ContainerStarted","Data":"4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3"}
Oct 30 21:39:55.936648 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:55.925188    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" event={"ID":"0f0935e2-78eb-4ed0-a007-84763f3fd807","Type":"ContainerStarted","Data":"75e55ca1f80be3859c9b04699bbef4fea70774a3b9bb9b6d617545ecd2b07b9a"}
Oct 30 21:39:56.054699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.054649    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:56.709675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.704011    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:39:56.709675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.704094    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:39:56.709675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.706393    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.740935    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.741008    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.741067    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.741223    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.741359    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.741676    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.741732    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:39:56.742582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.741764    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:39:56.782581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.758044    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:56.783159 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.768708    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:39:56.815640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.770014    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:56.815894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.815868    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:39:56.827578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.816368    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:39:56.831577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.827867    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:39:56.912581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.899498    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:56.912581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:56.900148    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:39:57.061632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.050882    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podStartSLOduration=4.050862215 podStartE2EDuration="4.050862215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:39:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:39:56.462689402 +0000 UTC m=+1390.958262753" watchObservedRunningTime="2026-10-30 21:39:57.050862215 +0000 UTC m=+1391.546435567"
Oct 30 21:39:57.158677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.071618    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:39:57.249605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.231265    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:39:57.249605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.243660    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:57.249605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.243747    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:57.501196 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.501152    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:57.737779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.737719    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:57.746602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.742130    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:57.746602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.742443    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:57.769575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.769465    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:39:57.798268 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.788927    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:39:57.799607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.788959    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:39:57.828733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.824873    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:57.909580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.889399    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:39:57.911608 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.911571    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:39:57.911815 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.911492    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:57.911979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.911955    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:57.912919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:57.912542    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 21:39:58.162675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.160927    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:58.313712 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.313665    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:58.535753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.535662    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:58.539666 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.539623    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:58.872643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.847901    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:58.986581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.928486    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:59.085587 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.939148    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 21:39:59.144786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:58.939263    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:39:59.146270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.012758    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:59.174658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.012800    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:39:59.306732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.306441    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:39:59.414670 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.401186    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:59.447482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.445730    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:39:59.472688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.472640    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:39:59.545704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.545641    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:59.634691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.580767    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:39:59.634971 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.634935    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:39:59.646644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.610926    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:39:59.646867 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.646835    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:39:59.873638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.854277    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:39:59.874867 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.873934    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:39:59.926718 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.925519    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:39:59.938238 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.938213    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:39:59.943901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.943646    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:39:59.943901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:39:59.943701    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:00.101737 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.101683    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:00.150638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.148390    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:00.150638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.148678    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:40:00.383397 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.383354    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:40:00.468772 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.468663    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:00.531047 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.530919    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:40:00.531047 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.530979    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:40:00.600579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.599950    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:00.600579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.600011    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:00.603584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.602142    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:00.603584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.602194    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:00.603584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.602295    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:00.603584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.602340    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:00.866640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.854380    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:00.939581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:00.913490    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:01.113693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.113357    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:01.220157 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.185700    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:40:01.220157 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.186020    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:40:01.276582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.272700    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:01.276582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.272768    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:01.329581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.302309    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:01.330021 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.329984    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:01.351851 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.346768    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:01.351851 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.346827    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:01.390713 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.390662    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:01.391015 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.390995    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:40:01.479839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.479742    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:40:01.535722 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.505906    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:40:01.535986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.535956    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:40:01.639883 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.639847    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:01.640171 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.640130    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:01.889751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.889643    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:40:01.923679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.889994    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:02.133701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:01.961365    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:02.134747 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.125678    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:02.138681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.134320    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:40:02.244749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.244701    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:02.245521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.245486    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:40:02.474691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.474643    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:40:02.503780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.501424    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 30 21:40:02.503780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.503642    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 30 21:40:02.553110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.546625    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:40:02.593166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.593038    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:02.593166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.593102    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:02.934348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.934307    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:40:02.935094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:02.935068    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:40:03.118604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.118238    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:40:03.151681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.138956    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 21:40:03.174147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.168189    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:03.174147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.168768    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:40:03.176874 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.175800    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:03.245636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.245189    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:40:03.253108 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.253057    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:03.318905 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.318804    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:40:03.319236 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.319213    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:40:03.327192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.327170    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:40:03.411658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.360824    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:40:03.417322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.417295    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:40:03.444754 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.444714    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:40:03.501329 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.500496    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:40:03.526667 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.526639    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:40:03.601695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.601656    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:03.601857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.601721    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:03.925856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:03.925806    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:40:04.015200 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.015167    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7298-5db199"]
Oct 30 21:40:04.015385 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.015362    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7298-5db199" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" containerName="test-curl-7298-5db199" containerID="cri-o://c75f7251e318ce7237e95066da143e719c10896707e4407f5adbfa36bf1c9593" gracePeriod=2
Oct 30 21:40:04.021269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.021237    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7298-5db199"]
Oct 30 21:40:04.118348 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:04.118313    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-5db199\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:40:04.195494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.193254    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7298-8ffe4d"]
Oct 30 21:40:04.195494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.194223    4943 cpu_manager.go:414] "containerMap: removing container" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" containerName="test-curl-7298-5db199"
Oct 30 21:40:04.195494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.194245    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" containerName="test-curl-7298-5db199"
Oct 30 21:40:04.195494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.194407    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" containerName="test-curl-7298-5db199"
Oct 30 21:40:04.207639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.207397    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:40:04.207639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.207505    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:04.226544 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.226514    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7298-8ffe4d"]
Oct 30 21:40:04.240523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.240488    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5rz\" (UniqueName: \"kubernetes.io/projected/2507ab7b-d22f-47a4-b202-87831af9c76c-kube-api-access-tq5rz\") pod \"test-curl-7298-8ffe4d\" (UID: \"2507ab7b-d22f-47a4-b202-87831af9c76c\") " pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:04.342417 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.342381    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5rz\" (UniqueName: \"kubernetes.io/projected/2507ab7b-d22f-47a4-b202-87831af9c76c-kube-api-access-tq5rz\") pod \"test-curl-7298-8ffe4d\" (UID: \"2507ab7b-d22f-47a4-b202-87831af9c76c\") " pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:04.407206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.407166    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5rz\" (UniqueName: \"kubernetes.io/projected/2507ab7b-d22f-47a4-b202-87831af9c76c-kube-api-access-tq5rz\") pod \"test-curl-7298-8ffe4d\" (UID: \"2507ab7b-d22f-47a4-b202-87831af9c76c\") " pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:04.523138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.523046    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:04.615581 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:04.612890    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-5db199\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:40:04.624737 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.624698    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:04.624893 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:04.624773    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:05.006098 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:40:05.006046    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2507ab7b_d22f_47a4_b202_87831af9c76c.slice/crio-b535ceadc63b4a6aa3f8aca70fceefdb030607bbcb2be57df2f1dac238ad34c0 WatchSource:0}: Error finding container b535ceadc63b4a6aa3f8aca70fceefdb030607bbcb2be57df2f1dac238ad34c0: Status 404 returned error can't find the container with id b535ceadc63b4a6aa3f8aca70fceefdb030607bbcb2be57df2f1dac238ad34c0
Oct 30 21:40:05.006263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:05.006198    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7298-8ffe4d"]
Oct 30 21:40:05.231524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:05.231485    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7298-8ffe4d" event={"ID":"2507ab7b-d22f-47a4-b202-87831af9c76c","Type":"ContainerStarted","Data":"aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1"}
Oct 30 21:40:05.231922 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:05.231532    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7298-8ffe4d" event={"ID":"2507ab7b-d22f-47a4-b202-87831af9c76c","Type":"ContainerStarted","Data":"b535ceadc63b4a6aa3f8aca70fceefdb030607bbcb2be57df2f1dac238ad34c0"}
Oct 30 21:40:05.293952 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:05.293834    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-5db199\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:40:05.423618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:05.423540    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-7298-8ffe4d" podStartSLOduration=1.42352055 podStartE2EDuration="1.42352055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:05.42195875 +0000 UTC m=+1399.917532102" watchObservedRunningTime="2026-10-30 21:40:05.42352055 +0000 UTC m=+1399.919093902"
Oct 30 21:40:05.592712 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:05.592608    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:05.592712 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:05.592672    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:05.668789 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:05.668745    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-5db199\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:40:06.241779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.241747    4943 generic.go:356] "Generic (PLEG): container finished" podID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" containerID="c75f7251e318ce7237e95066da143e719c10896707e4407f5adbfa36bf1c9593" exitCode=137
Oct 30 21:40:06.325422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.325394    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:40:06.495409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.495350    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/62ce8ad2-38d5-466d-9ebb-215327b1d2d4-kube-api-access-zjj6q\" (UniqueName: \"kubernetes.io/projected/62ce8ad2-38d5-466d-9ebb-215327b1d2d4-kube-api-access-zjj6q\") pod \"62ce8ad2-38d5-466d-9ebb-215327b1d2d4\" (UID: \"62ce8ad2-38d5-466d-9ebb-215327b1d2d4\") "
Oct 30 21:40:06.497544 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.497509    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62ce8ad2-38d5-466d-9ebb-215327b1d2d4-kube-api-access-zjj6q" pod "62ce8ad2-38d5-466d-9ebb-215327b1d2d4" (UID: "62ce8ad2-38d5-466d-9ebb-215327b1d2d4"). InnerVolumeSpecName "kube-api-access-zjj6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:40:06.592525 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.592438    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:06.592525 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.592505    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:06.597258 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.597228    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjj6q\" (UniqueName: \"kubernetes.io/projected/62ce8ad2-38d5-466d-9ebb-215327b1d2d4-kube-api-access-zjj6q\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:06.657061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.655959    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:06.990141 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.990107    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7298-8ffe4d"]
Oct 30 21:40:06.995905 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:06.995881    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7298-8ffe4d"]
Oct 30 21:40:07.281653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:07.280730    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:40:07.281653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:07.280783    4943 scope.go:122] "RemoveContainer" containerID="c75f7251e318ce7237e95066da143e719c10896707e4407f5adbfa36bf1c9593"
Oct 30 21:40:07.281653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:07.281298    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-7298-8ffe4d" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" containerName="test-curl-7298-8ffe4d" containerID="cri-o://aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1" gracePeriod=2
Oct 30 21:40:07.331719 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:07.331678    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-8ffe4d\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:07.382025 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:07.381989    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-8ffe4d\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:07.432297 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:07.432261    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-5db199\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" pod="opendatahub/test-curl-7298-5db199"
Oct 30 21:40:07.591895 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:07.591805    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 30 21:40:07.591895 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:07.591868    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 30 21:40:07.619482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:07.619447    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="62ce8ad2-38d5-466d-9ebb-215327b1d2d4" path="/var/lib/kubelet/pods/62ce8ad2-38d5-466d-9ebb-215327b1d2d4/volumes"
Oct 30 21:40:07.823219 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:07.823183    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:08.017090 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:08.017055    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:08.216401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:08.216360    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:08.428165 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:08.428126    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:08.594580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:08.594059    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:40:08.640700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:08.636788    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:08.832633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:08.828167    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:09.099884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.099782    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"]
Oct 30 21:40:09.100704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.100676    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" containerName="test-curl-7298-8ffe4d"
Oct 30 21:40:09.100704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.100702    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" containerName="test-curl-7298-8ffe4d"
Oct 30 21:40:09.100931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.100842    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" containerName="test-curl-7298-8ffe4d"
Oct 30 21:40:09.105746 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.105723    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.121481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.121449    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196534    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196612    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8sfb\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-kube-api-access-s8sfb\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196654    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196684    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196721    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196784    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196815    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.196926    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.215578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.197027    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5252078-892f-404c-b5fe-9d4cbe3c118b-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.269347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.269313    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"]
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.299861    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.299911    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.300021    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.301600    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5252078-892f-404c-b5fe-9d4cbe3c118b-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.300480    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.301751    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.301784    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8sfb\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-kube-api-access-s8sfb\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.301820    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.301847    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.301885    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.302316    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.301422    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.303577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.302889    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.336902 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.335483    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5252078-892f-404c-b5fe-9d4cbe3c118b-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.390628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.337858    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.390628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.386584    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.404050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.400767    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8sfb\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-kube-api-access-s8sfb\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.404050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.401225    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.421411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.421379    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:09.551575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.536330    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:40:09.551575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.540645    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:40:09.667368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.667047    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:09.720858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.720830    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:09.858582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.857682    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2507ab7b-d22f-47a4-b202-87831af9c76c-kube-api-access-tq5rz\" (UniqueName: \"kubernetes.io/projected/2507ab7b-d22f-47a4-b202-87831af9c76c-kube-api-access-tq5rz\") pod \"2507ab7b-d22f-47a4-b202-87831af9c76c\" (UID: \"2507ab7b-d22f-47a4-b202-87831af9c76c\") "
Oct 30 21:40:09.875580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.875216    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2507ab7b-d22f-47a4-b202-87831af9c76c-kube-api-access-tq5rz" pod "2507ab7b-d22f-47a4-b202-87831af9c76c" (UID: "2507ab7b-d22f-47a4-b202-87831af9c76c"). InnerVolumeSpecName "kube-api-access-tq5rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:40:09.904046 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.904010    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:09.928816 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:40:09.928775    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5252078_892f_404c_b5fe_9d4cbe3c118b.slice/crio-fdc18d4fcbbd30ca63cb8a0cba985a060e08ef78d65fcd7d2e41cbeeb447bd39 WatchSource:0}: Error finding container fdc18d4fcbbd30ca63cb8a0cba985a060e08ef78d65fcd7d2e41cbeeb447bd39: Status 404 returned error can't find the container with id fdc18d4fcbbd30ca63cb8a0cba985a060e08ef78d65fcd7d2e41cbeeb447bd39
Oct 30 21:40:09.933165 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.933133    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"]
Oct 30 21:40:09.940607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.933867    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:09.940607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.934101    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:09.940607 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.934224    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:09.963451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:09.963305    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tq5rz\" (UniqueName: \"kubernetes.io/projected/2507ab7b-d22f-47a4-b202-87831af9c76c-kube-api-access-tq5rz\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:40:10.321587 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.321481    4943 generic.go:356] "Generic (PLEG): container finished" podID="2507ab7b-d22f-47a4-b202-87831af9c76c" containerID="aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1" exitCode=137
Oct 30 21:40:10.321758 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.321603    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:10.321758 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.321616    4943 scope.go:122] "RemoveContainer" containerID="aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1"
Oct 30 21:40:10.323856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.323827    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" event={"ID":"f5252078-892f-404c-b5fe-9d4cbe3c118b","Type":"ContainerStarted","Data":"82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48"}
Oct 30 21:40:10.323989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.323877    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" event={"ID":"f5252078-892f-404c-b5fe-9d4cbe3c118b","Type":"ContainerStarted","Data":"fdc18d4fcbbd30ca63cb8a0cba985a060e08ef78d65fcd7d2e41cbeeb447bd39"}
Oct 30 21:40:10.333252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.333238    4943 scope.go:122] "RemoveContainer" containerID="aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1"
Oct 30 21:40:10.333513 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:10.333493    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1\": container with ID starting with aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1 not found: ID does not exist" containerID="aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1"
Oct 30 21:40:10.333606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.333520    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1"} err="failed to get container status \"aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1\": rpc error: code = NotFound desc = could not find container \"aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1\": container with ID starting with aea53a2118677b7309626cb7cb17aa5e03d8c4160a0e65577e17df64afe13cd1 not found: ID does not exist"
Oct 30 21:40:10.422205 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.422175    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:10.442449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.442312    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podStartSLOduration=1.442297259 podStartE2EDuration="1.442297259s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:10.43900692 +0000 UTC m=+1404.934580271" watchObservedRunningTime="2026-10-30 21:40:10.442297259 +0000 UTC m=+1404.937870650"
Oct 30 21:40:10.489465 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:10.489423    4943 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-7298-8ffe4d\" is forbidden: User \"system:node:ip-10-0-135-205.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-205.us-west-1.compute.internal' and this object" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" pod="opendatahub/test-curl-7298-8ffe4d"
Oct 30 21:40:10.921141 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:10.921107    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:11.424387 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:11.424360    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:40:11.424541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:11.424407    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:40:11.521863 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:11.521833    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:11.681634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:11.681452    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2507ab7b-d22f-47a4-b202-87831af9c76c" path="/var/lib/kubelet/pods/2507ab7b-d22f-47a4-b202-87831af9c76c/volumes"
Oct 30 21:40:11.711766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:11.711646    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:12.375390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:12.375315    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:12.432603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:12.431654    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:40:12.432603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:12.431710    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:40:12.556823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:12.556788    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:12.810832 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:12.810778    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:13.422300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:13.422265    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:40:13.422769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:13.422327    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:40:13.575580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:13.575005    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:13.770143 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:13.770030    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:13.960449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:13.960410    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:14.421932 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:14.421897    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:40:14.422124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:14.421958    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:40:14.619770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:14.619735    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:14.818059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:14.817965    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:15.421879 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:15.421835    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:40:15.422083 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:15.421887    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:40:16.421881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:16.421839    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 30 21:40:16.422368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:16.421904    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 30 21:40:16.448891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:16.448858    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:16.635026 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:16.634993    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:16.998010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:16.997487    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:17.198156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:17.198124    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:17.399017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:17.398977    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:17.631484 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:17.631455    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:17.631977 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:17.631843    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:17.632793 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:17.632768    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:40:18.028614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:18.028041    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:18.222610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:18.222566    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:19.460340 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:19.460292    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:19.640813 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:19.640775    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:20.054603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:20.054569    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:20.239270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:20.239227    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:21.063325 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:21.063291    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:40:21.964266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:21.964208    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:22.141187 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:22.141143    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:23.278383 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:23.278347    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:23.544003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:23.543929    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:24.233315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.233284    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"]
Oct 30 21:40:24.238833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.238816    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.329023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.328995    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"]
Oct 30 21:40:24.359947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.359918    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.359954    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.360126    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360230 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.360196    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360276 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.360248    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.360290    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.360316    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.360430    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.360497 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.360459    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxps8\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-kube-api-access-nxps8\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.461536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.461500    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.462351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.462328    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.462612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.462595    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.462747 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.462236    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-data\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.462848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.462832    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.462967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.462954    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.463082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.463069    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.463695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.463348    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.463850 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.463634    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.464034 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.463988    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-certs\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.464170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.464052    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.464170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.464082    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxps8\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-kube-api-access-nxps8\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.465021 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.464975    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istiod-ca-cert\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.465395 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.465377    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-credential-socket\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.468875 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.468849    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-envoy\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.481220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.481201    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-podinfo\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.519280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.519218    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-token\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.520076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.520051    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxps8\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-kube-api-access-nxps8\") pod \"e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") " pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.542859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.542833    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:24.554372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.554348    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:24.773651 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:24.772324    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:25.031631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.030840    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"]
Oct 30 21:40:25.071936 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.043782    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:25.071936 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.043870    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:25.071936 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.043913    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:25.475232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.475194    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" event={"ID":"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206","Type":"ContainerStarted","Data":"dbb85dbb2f9b300c7b75e693fa8a2b17f15d8b2ecf2e734d35142d23ee4cc1b3"}
Oct 30 21:40:25.475876 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.475851    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" event={"ID":"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206","Type":"ContainerStarted","Data":"53cf623c8481624d56b477ce9a387ef13a4dde3fec232f3d59b93af16e7155b4"}
Oct 30 21:40:25.554463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.554426    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:25.595674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:25.595608    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podStartSLOduration=1.595589087 podStartE2EDuration="1.595589087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:25.591517558 +0000 UTC m=+1420.087090909" watchObservedRunningTime="2026-10-30 21:40:25.595589087 +0000 UTC m=+1420.091162439"
Oct 30 21:40:26.568576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:26.567672    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:40:26.568576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:26.567740    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:40:27.066615 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:27.042535    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:27.324637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:27.292623    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:27.495598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:27.495448    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:27.564581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:27.556671    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:40:27.564581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:27.556737    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:40:28.560581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:28.559906    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:40:28.560581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:28.559963    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:40:29.555386 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.554919    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:40:29.555386 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.555010    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:40:29.890671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.890581    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"]
Oct 30 21:40:29.895764 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.895742    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:29.998358 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.998329    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 30 21:40:29.998575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.998430    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 30 21:40:29.998575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.998450    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 30 21:40:29.998575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.998504    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bckcj\""
Oct 30 21:40:29.999427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.999395    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:29.999613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.999590    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:29.999709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.999658    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8962662a-bba0-49a1-9440-eb69857c34c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:29.999709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.999696    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8962662a-bba0-49a1-9440-eb69857c34c4-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:29.999824 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.999748    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc6zw\" (UniqueName: \"kubernetes.io/projected/8962662a-bba0-49a1-9440-eb69857c34c4-kube-api-access-jc6zw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:29.999824 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:29.999772    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8962662a-bba0-49a1-9440-eb69857c34c4-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.000057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.000029    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.002579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.002547    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"]
Oct 30 21:40:30.101594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.101523    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8962662a-bba0-49a1-9440-eb69857c34c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.101760 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.101635    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8962662a-bba0-49a1-9440-eb69857c34c4-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.101760 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.101696    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc6zw\" (UniqueName: \"kubernetes.io/projected/8962662a-bba0-49a1-9440-eb69857c34c4-kube-api-access-jc6zw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.101760 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.101720    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8962662a-bba0-49a1-9440-eb69857c34c4-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.101869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.101767    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.101869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.101816    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.101941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.101918    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.102793 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.102758    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8962662a-bba0-49a1-9440-eb69857c34c4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.105704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.105678    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.105809 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.105758    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.106057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.106034    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8962662a-bba0-49a1-9440-eb69857c34c4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.107382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.107362    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8962662a-bba0-49a1-9440-eb69857c34c4-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.196581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.178186    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc6zw\" (UniqueName: \"kubernetes.io/projected/8962662a-bba0-49a1-9440-eb69857c34c4-kube-api-access-jc6zw\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.204109 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.202357    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8962662a-bba0-49a1-9440-eb69857c34c4-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-4hmln\" (UID: \"8962662a-bba0-49a1-9440-eb69857c34c4\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.206651 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.206611    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:30.209451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.209426    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:30.574625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.573889    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:40:30.574625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.573949    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:40:30.682705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.681410    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"]
Oct 30 21:40:30.960174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:30.960070    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:31.150400 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:31.150349    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:31.383885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:31.383782    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:31.555455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:31.555419    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 30 21:40:31.555677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:31.555490    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 30 21:40:31.559042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:31.559011    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln" event={"ID":"8962662a-bba0-49a1-9440-eb69857c34c4","Type":"ContainerStarted","Data":"ef80a6540ed2390ff3c379a3b0bd11454273b8cc3eb5fbb57b795900b266831f"}
Oct 30 21:40:32.036699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:32.036663    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:32.944580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:32.944272    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:33.557671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:33.557634    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:33.558259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:33.558230    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:34.458734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:34.458691    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:34.571717 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:34.571679    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:34.572208 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:34.571753    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:34.802777 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:34.802669    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:35.113781 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.113654    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 21:40:35.131845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.131788    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:35.154381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.153674    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:35.154381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.154072    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:40:35.179682 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.179637    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:35.793586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.777430    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:35.956580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.872682    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:35.956580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.932799    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 21:40:35.965424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.965375    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/health\": context deadline exceeded"
Oct 30 21:40:36.069188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:35.988964    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:36.069188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.064689    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:36.179581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.135885    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:36.179581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.139643    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:36.179581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.173840    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:36.223582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.199063    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:36.393632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.385460    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:36.442730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.442669    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:40:36.728909 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:36.728871    4943 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.053s"
Oct 30 21:40:36.729478 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.729456    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:40:36.748710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.748679    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:40:36.749615 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.749592    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:40:36.749823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.749808    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:40:36.749972 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.749959    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:40:36.753576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.750105    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:40:36.805726 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.805691    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:40:36.823663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.823628    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:40:36.880609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:36.838774    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:37.014668 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.011929    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:37.014668 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.012347    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:40:37.102581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.077778    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:37.114093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.097629    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:37.114382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.114345    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:37.141576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.137829    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:37.147991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.140631    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:37.280780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.253659    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:37.457579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.446699    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:37.457579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:37.448407    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:40:38.007240 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.007204    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:38.033579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.012773    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 21:40:38.104284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.104236    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": context deadline exceeded"
Oct 30 21:40:38.154226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.154184    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:40:38.211609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.169081    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:38.213283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.212998    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:38.216350 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.216312    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:38.226540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.226419    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:38.258709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.258499    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:38.259021 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.258599    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:38.259246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.258942    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:38.340776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.340733    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/health\": context deadline exceeded"
Oct 30 21:40:38.349738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.349701    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:38.452062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.452021    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:38.491635 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.456627    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:40:38.492997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.456670    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:38.493273 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.493227    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:38.727688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:38.727645    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/health\": context deadline exceeded"
Oct 30 21:40:39.028239 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.028136    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:39.047585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.044005    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:39.112816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.112768    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:39.196696 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.196645    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:40:39.223538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.197258    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:40:39.223538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.198700    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:39.223538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.223069    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 21:40:39.280630 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.280139    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 30 21:40:39.323096 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.323054    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:40:39.324750 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.324714    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:39.383770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.383717    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:39.637092 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.636982    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:40:39.682488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:39.671014    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:40:40.038723 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.038684    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:40.080581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.079427    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:40.137593 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.127377    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:40.213810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.213286    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": context deadline exceeded"
Oct 30 21:40:40.213810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.213777    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 30 21:40:40.225629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.224027    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": context deadline exceeded"
Oct 30 21:40:40.237212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.237175    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:40.237951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.237869    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:40.295811 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.295736    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:40:40.297084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.297062    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:40:40.304740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.301883    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:40:40.304740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.304294    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:40:40.339039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.331002    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:40:40.339039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.335125    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 21:40:40.339039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.336308    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:40:40.340512 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.340431    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:40:40.341112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.340954    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:40:40.354691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.354671    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:40:40.575138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:40.574976    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:41.867669 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:41.867632    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:41.867976 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:41.867718    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:40:42.199789 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:42.199761    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:42.367430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:42.367399    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln" event={"ID":"8962662a-bba0-49a1-9440-eb69857c34c4","Type":"ContainerStarted","Data":"3cbc3f835015d216519963bf434f26f8b93f95372c7cd5472d0a055fe3f13330"}
Oct 30 21:40:42.367637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:42.367590    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:42.369022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:42.368983    4943 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:40:42.369154 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:42.369039    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln" podUID="8962662a-bba0-49a1-9440-eb69857c34c4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:42.485211 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:42.485120    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln" podStartSLOduration=2.303999792 podStartE2EDuration="13.485106712s" totalImagesPullingTime="11.18110692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:40:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:40:42.482310105 +0000 UTC m=+1436.977883455" watchObservedRunningTime="2026-10-30 21:40:42.485106712 +0000 UTC m=+1436.980680064"
Oct 30 21:40:42.876022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:42.875942    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:43.385982 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:43.385939    4943 patch_prober.go:29] interesting pod/istiod-openshift-gateway-7ddd9cfdc8-4hmln container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:40:43.387779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:43.386009    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln" podUID="8962662a-bba0-49a1-9440-eb69857c34c4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:40:44.102897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:44.102843    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:44.763782 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:44.763742    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:44.964959 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:44.964927    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:45.306211 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:45.306173    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:46.384067 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:46.383986    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-4hmln"
Oct 30 21:40:50.008602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:50.008541    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:51.067384 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:40:51.067342    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:40:51.292874 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:51.292833    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:54.695527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:54.695493    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:57.391586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:57.391531    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:59.595609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:59.594141    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:40:59.805839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:40:59.805807    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:00.070453 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:00.070419    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:03.289624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.289585    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"]
Oct 30 21:41:03.300029 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.299998    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428458    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428499    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428593    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428685    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428736    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428772    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428845    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdjbd\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-kube-api-access-mdjbd\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428934    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.428988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.428976    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.502854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.502815    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"]
Oct 30 21:41:03.530672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.530639    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.530844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.530774    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.530844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.530799    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.530844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.530836    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531023    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531133 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531096    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531133 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531104    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-credential-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531126    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-certs\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531132    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531177    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdjbd\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-kube-api-access-mdjbd\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531254    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531403    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-data\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.531669 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.531643    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-socket\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.532297 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.532275    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istiod-ca-cert\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.535644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.534439    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-envoy\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.535644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.534504    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-podinfo\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.587806 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.587733    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-token\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.587945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.587854    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdjbd\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-kube-api-access-mdjbd\") pod \"e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") " pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.613861 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.613834    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:03.841518 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:03.841437    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:04.051840 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:41:04.051809    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc303bb6b_cedb_4bbb_a3e7_f1b3a0801a9a.slice/crio-627919dd18c5fd01a575784651b34c93389eaf9a6b9f0673dc0803a8e229e793 WatchSource:0}: Error finding container 627919dd18c5fd01a575784651b34c93389eaf9a6b9f0673dc0803a8e229e793: Status 404 returned error can't find the container with id 627919dd18c5fd01a575784651b34c93389eaf9a6b9f0673dc0803a8e229e793
Oct 30 21:41:04.053550 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.053520    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"]
Oct 30 21:41:04.054772 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.054737    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:04.054863 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.054818    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:04.054901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.054860    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:04.358360 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.358229    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:04.530862 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.530818    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:04.705288 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.705247    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:04.797903 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.797860    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" event={"ID":"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a","Type":"ContainerStarted","Data":"6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d"}
Oct 30 21:41:04.798120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.797929    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" event={"ID":"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a","Type":"ContainerStarted","Data":"627919dd18c5fd01a575784651b34c93389eaf9a6b9f0673dc0803a8e229e793"}
Oct 30 21:41:04.946580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:04.943282    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podStartSLOduration=1.943262987 podStartE2EDuration="1.943262987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:04.941332827 +0000 UTC m=+1459.436906178" watchObservedRunningTime="2026-10-30 21:41:04.943262987 +0000 UTC m=+1459.438836340"
Oct 30 21:41:05.618044 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:05.618016    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:41:05.618509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:05.618473    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:41:05.621160 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:05.621141    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:06.614293 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:06.614259    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:41:06.614478 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:06.614304    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:41:07.614673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:07.614636    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:41:07.615111 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:07.614694    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:41:08.614623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.614586    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:41:08.614800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.614691    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:41:08.893224 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.893144    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"]
Oct 30 21:41:08.903532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.903497    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:08.975578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.970176    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0453ec6-ab6a-4de6-8f44-83344720987c-openshift-service-ca\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:08.975578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.970387    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-metrics-certs\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:08.975578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.970440    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:08.975578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.970533    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cq4g\" (UniqueName: \"kubernetes.io/projected/d0453ec6-ab6a-4de6-8f44-83344720987c-kube-api-access-9cq4g\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:08.982266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:08.982237    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"]
Oct 30 21:41:09.006300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.006275    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-385396af-serving-cert\""
Oct 30 21:41:09.075660 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.075626    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0453ec6-ab6a-4de6-8f44-83344720987c-openshift-service-ca\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.076055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.076031    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-metrics-certs\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.076206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.076191    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.076391 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.076374    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cq4g\" (UniqueName: \"kubernetes.io/projected/d0453ec6-ab6a-4de6-8f44-83344720987c-kube-api-access-9cq4g\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.077752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.077729    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0453ec6-ab6a-4de6-8f44-83344720987c-openshift-service-ca\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.078790 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:41:09.078771    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-385396af-serving-cert: secret "maas-api-e2e-derive-385396af-serving-cert" not found
Oct 30 21:41:09.078963 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:41:09.078951    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls podName:d0453ec6-ab6a-4de6-8f44-83344720987c nodeName:}" failed. No retries permitted until 2026-10-30 21:41:09.578930184 +0000 UTC m=+1464.074503528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls") pod "maas-api-e2e-derive-385396af-59858498cf-qh522" (UID: "d0453ec6-ab6a-4de6-8f44-83344720987c") : secret "maas-api-e2e-derive-385396af-serving-cert" not found
Oct 30 21:41:09.087721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.087700    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-metrics-certs\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.130487 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.130450    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:09.133974 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.133943    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cq4g\" (UniqueName: \"kubernetes.io/projected/d0453ec6-ab6a-4de6-8f44-83344720987c-kube-api-access-9cq4g\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.301948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.301917    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:09.480580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.477722    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:09.599040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.598958    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.601523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.601492    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls\") pod \"maas-api-e2e-derive-385396af-59858498cf-qh522\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:09.614729 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.614703    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:41:09.614855 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.614751    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:41:09.819510 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:09.819479    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:10.232590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:10.232564    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"]
Oct 30 21:41:10.234466 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:41:10.234436    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0453ec6_ab6a_4de6_8f44_83344720987c.slice/crio-21885a595a3e0f48f155d05dc3c573dc313ae466bdc41a71e102470586014fbe WatchSource:0}: Error finding container 21885a595a3e0f48f155d05dc3c573dc313ae466bdc41a71e102470586014fbe: Status 404 returned error can't find the container with id 21885a595a3e0f48f155d05dc3c573dc313ae466bdc41a71e102470586014fbe
Oct 30 21:41:10.614629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:10.614524    4943 patch_prober.go:29] interesting pod/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Oct 30 21:41:10.614629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:10.614590    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Oct 30 21:41:10.846104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:10.846070    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522" event={"ID":"d0453ec6-ab6a-4de6-8f44-83344720987c","Type":"ContainerStarted","Data":"21885a595a3e0f48f155d05dc3c573dc313ae466bdc41a71e102470586014fbe"}
Oct 30 21:41:11.624376 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:11.624335    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:11.625059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:11.625034    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:11.625608 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:11.625589    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:41:11.854449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:11.854412    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522" event={"ID":"d0453ec6-ab6a-4de6-8f44-83344720987c","Type":"ContainerStarted","Data":"80b67c8a2d8f7aade6aec57a5e73032210b7d6bc83e441ac75e24dbe95ca8cf7"}
Oct 30 21:41:11.854867 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:11.854738    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:12.041096 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:12.041041    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522" podStartSLOduration=3.214489672 podStartE2EDuration="4.041023331s" totalImagesPullingTime="826.533659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:12.024537161 +0000 UTC m=+1466.520110514" watchObservedRunningTime="2026-10-30 21:41:12.041023331 +0000 UTC m=+1466.536596683"
Oct 30 21:41:14.106418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:14.106380    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:17.874531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:17.874501    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:41:18.808605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:18.807142    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:20.707022 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:20.706987    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:21.064057 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:41:21.063977    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:41:23.517959 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:23.517895    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:28.181327 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:28.181230    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:33.036895 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:33.036856    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:36.629647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.629603    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"]
Oct 30 21:41:36.633934 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.633911    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.685823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.685791    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-x8rmh\""
Oct 30 21:41:36.715395 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.715361    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7721f4-0078-43e6-be9c-3250a4a3e250-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.715545 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.715459    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.715692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.715666    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.715770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.715735    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.715826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.715779    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.716000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.715982    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.716099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.716082    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.716164 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.716106    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64cdk\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-kube-api-access-64cdk\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.716543 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.716179    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.741166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.741130    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"]
Oct 30 21:41:36.817837 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.817810    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.817990 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.817872    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818033 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.817982    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64cdk\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-kube-api-access-64cdk\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818126 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818096    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818211    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7721f4-0078-43e6-be9c-3250a4a3e250-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818255    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818309    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818339    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818368    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818393    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818409    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818640    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818824    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.818945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.818925    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7721f4-0078-43e6-be9c-3250a4a3e250-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.820475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.820455    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.820584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.820494    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.875431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.875400    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64cdk\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-kube-api-access-64cdk\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.875857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.875834    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nsqr4\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:36.949841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:36.949814    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:37.383215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:37.383183    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"]
Oct 30 21:41:37.384741 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:41:37.384710    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7721f4_0078_43e6_be9c_3250a4a3e250.slice/crio-7eed55c17716eb20888c5b77262768809c36dbd17d24b7a42dd7016a58afa737 WatchSource:0}: Error finding container 7eed55c17716eb20888c5b77262768809c36dbd17d24b7a42dd7016a58afa737: Status 404 returned error can't find the container with id 7eed55c17716eb20888c5b77262768809c36dbd17d24b7a42dd7016a58afa737
Oct 30 21:41:37.387771 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:37.387737    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:37.387890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:37.387816    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:37.387890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:37.387862    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:37.781252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:37.781213    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:38.082474 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:38.082383    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" event={"ID":"7f7721f4-0078-43e6-be9c-3250a4a3e250","Type":"ContainerStarted","Data":"758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3"}
Oct 30 21:41:38.082650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:38.082488    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" event={"ID":"7f7721f4-0078-43e6-be9c-3250a4a3e250","Type":"ContainerStarted","Data":"7eed55c17716eb20888c5b77262768809c36dbd17d24b7a42dd7016a58afa737"}
Oct 30 21:41:38.201005 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:38.200950    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podStartSLOduration=2.20093586 podStartE2EDuration="2.20093586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:38.198398334 +0000 UTC m=+1492.693971685" watchObservedRunningTime="2026-10-30 21:41:38.20093586 +0000 UTC m=+1492.696509211"
Oct 30 21:41:38.955576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:38.952277    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:38.955576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:38.952430    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:41:38.955576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:38.952476    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 21:41:39.957934 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:39.957896    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:41:39.958532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:39.958497    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 21:41:40.493294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.493262    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"]
Oct 30 21:41:40.497427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.497403    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.561915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.561884    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-bed6793d-openshift-default-dockercfg-6ldgq\""
Oct 30 21:41:40.604069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604033    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-socket\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604221 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604105    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-istio-token\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604302 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604253    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acbab482-85d1-496d-9b85-83911c0feff1-istio-podinfo\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604362 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604304    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-certs\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604400    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-data\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604439    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-credential-socket\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604576    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44bsd\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-kube-api-access-44bsd\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604665    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-envoy\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.604750 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.604692    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acbab482-85d1-496d-9b85-83911c0feff1-istiod-ca-cert\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.705508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.705475    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acbab482-85d1-496d-9b85-83911c0feff1-istiod-ca-cert\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.705694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.705601    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-socket\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.705750 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.705692    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-istio-token\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.705805 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.705758    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acbab482-85d1-496d-9b85-83911c0feff1-istio-podinfo\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.705805 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.705794    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-certs\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.705978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.705948    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-data\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706026    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-credential-socket\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706146 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706108    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-certs\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706146 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706119    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44bsd\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-kube-api-access-44bsd\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706262 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706174    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-socket\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706262 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706225    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-envoy\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706262 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706251    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acbab482-85d1-496d-9b85-83911c0feff1-istiod-ca-cert\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706414 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706355    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-data\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.706496 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.706468    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-credential-socket\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.708432 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.708410    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acbab482-85d1-496d-9b85-83911c0feff1-istio-podinfo\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.708790 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.708759    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-envoy\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.723795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.723768    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"]
Oct 30 21:41:40.779647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.778660    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-istio-token\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.780300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.780273    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44bsd\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-kube-api-access-44bsd\") pod \"e2e-ait-bed6793d-openshift-default-649f995d97-2rptf\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") " pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.812645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.812615    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:40.967580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.955710    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:41:40.967580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:40.955768    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 21:41:41.281947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:41.281916    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"]
Oct 30 21:41:41.285193 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:41:41.285160    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbab482_85d1_496d_9b85_83911c0feff1.slice/crio-dc0f1c02f77931d96de7859fceae77f209948238a836c6cb9f257c3e32b12553 WatchSource:0}: Error finding container dc0f1c02f77931d96de7859fceae77f209948238a836c6cb9f257c3e32b12553: Status 404 returned error can't find the container with id dc0f1c02f77931d96de7859fceae77f209948238a836c6cb9f257c3e32b12553
Oct 30 21:41:41.288246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:41.288213    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:41.288353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:41.288293    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:41.288353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:41.288339    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:41:41.952411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:41.952371    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:41:41.952745 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:41.952714    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 21:41:42.122460 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.122424    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" event={"ID":"acbab482-85d1-496d-9b85-83911c0feff1","Type":"ContainerStarted","Data":"24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408"}
Oct 30 21:41:42.122881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.122503    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" event={"ID":"acbab482-85d1-496d-9b85-83911c0feff1","Type":"ContainerStarted","Data":"dc0f1c02f77931d96de7859fceae77f209948238a836c6cb9f257c3e32b12553"}
Oct 30 21:41:42.311635 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.311301    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podStartSLOduration=2.311277574 podStartE2EDuration="2.311277574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:41:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:41:42.294334633 +0000 UTC m=+1496.789907987" watchObservedRunningTime="2026-10-30 21:41:42.311277574 +0000 UTC m=+1496.806850933"
Oct 30 21:41:42.565628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.564470    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:42.818811 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.818718    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:42.820306 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.820278    4943 patch_prober.go:29] interesting pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:41:42.820600 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.820531    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:41:42.982580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.965974    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:41:42.982580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:42.966038    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 21:41:43.813744 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:43.813696    4943 patch_prober.go:29] interesting pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:41:43.814161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:43.813804    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:41:43.951579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:43.950923    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:41:43.951579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:43.950984    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 21:41:44.438965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:44.438928    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:44.813412 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:44.813333    4943 patch_prober.go:29] interesting pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:41:44.813412 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:44.813391    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:41:44.951578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:44.950887    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 30 21:41:44.951578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:44.950946    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 30 21:41:45.813181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:45.813146    4943 patch_prober.go:29] interesting pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:41:45.813495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:45.813459    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:41:45.859577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:45.855843    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:41:45.859577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:45.856610    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:41:46.813061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:46.813029    4943 patch_prober.go:29] interesting pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:41:46.813546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:46.813086    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:41:47.056155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.053713    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:41:47.056155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.053776    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:41:47.092792 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.092705    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:47.094480 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.094458    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:47.095161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.095140    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 21:41:47.464245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.464191    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:47.813135 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.813053    4943 patch_prober.go:29] interesting pod/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 30 21:41:47.813135 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:47.813119    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 30 21:41:48.817762 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:48.817731    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:48.818269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:48.818182    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:48.818913 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:48.818891    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:41:51.063811 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:41:51.063770    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:41:52.165413 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:52.165369    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:41:57.077372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:41:57.077321    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:02.047323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:02.047285    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:03.098434 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:03.098390    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:03.304886 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:03.304839    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:07.422950 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:07.422912    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:12.638189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:12.638151    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:14.035008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:14.034967    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:16.771961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:16.771924    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:16.952785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:16.952742    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:17.863455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:17.863416    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:18.543118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:18.543069    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:21.065333 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:42:21.065292    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:42:22.800889 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:22.800827    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:23.426109 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:23.426073    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:23.626241 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:23.626205    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:24.945279 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:24.944610    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:26.003080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:26.003027    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:26.206051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:26.206008    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:27.606765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:27.606703    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:27.859695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:27.859616    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:28.573951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:28.573913    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:28.927798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:28.927750    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:29.936675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:29.936635    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:30.134641 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:30.134596    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:32.597755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:32.597716    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:33.521351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:33.521306    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:33.723955 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:33.723919    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:36.690920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:36.690879    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:36.883251 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:36.883209    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:37.924194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:37.924157    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:42.605914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:42.605876    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:44.874980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:44.874938    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:46.903152 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:46.903113    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:48.109709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:48.109640    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:48.476527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:48.476470    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:48.920528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:48.920452    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:49.135005 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.134965    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"]
Oct 30 21:42:49.135514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.135215    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy" containerID="cri-o://24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408" gracePeriod=30
Oct 30 21:42:49.187597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.187465    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:49.279673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.279637    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"]
Oct 30 21:42:49.280222 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.280190    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522" podUID="d0453ec6-ab6a-4de6-8f44-83344720987c" containerName="maas-api" containerID="cri-o://80b67c8a2d8f7aade6aec57a5e73032210b7d6bc83e441ac75e24dbe95ca8cf7" gracePeriod=30
Oct 30 21:42:49.444574 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.444470    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:49.822272 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.822191    4943 generic.go:356] "Generic (PLEG): container finished" podID="d0453ec6-ab6a-4de6-8f44-83344720987c" containerID="80b67c8a2d8f7aade6aec57a5e73032210b7d6bc83e441ac75e24dbe95ca8cf7" exitCode=0
Oct 30 21:42:49.822769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.822466    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522" event={"ID":"d0453ec6-ab6a-4de6-8f44-83344720987c","Type":"ContainerDied","Data":"80b67c8a2d8f7aade6aec57a5e73032210b7d6bc83e441ac75e24dbe95ca8cf7"}
Oct 30 21:42:49.902575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.888008    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:49.945215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:49.945060    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:42:50.005200 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.005164    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0453ec6-ab6a-4de6-8f44-83344720987c-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0453ec6-ab6a-4de6-8f44-83344720987c-openshift-service-ca\") pod \"d0453ec6-ab6a-4de6-8f44-83344720987c\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") "
Oct 30 21:42:50.005858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.005840    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls\") pod \"d0453ec6-ab6a-4de6-8f44-83344720987c\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") "
Oct 30 21:42:50.006041 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.006028    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-metrics-certs\") pod \"d0453ec6-ab6a-4de6-8f44-83344720987c\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") "
Oct 30 21:42:50.006228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.006215    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0453ec6-ab6a-4de6-8f44-83344720987c-kube-api-access-9cq4g\" (UniqueName: \"kubernetes.io/projected/d0453ec6-ab6a-4de6-8f44-83344720987c-kube-api-access-9cq4g\") pod \"d0453ec6-ab6a-4de6-8f44-83344720987c\" (UID: \"d0453ec6-ab6a-4de6-8f44-83344720987c\") "
Oct 30 21:42:50.008850 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.005756    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0453ec6-ab6a-4de6-8f44-83344720987c-openshift-service-ca" pod "d0453ec6-ab6a-4de6-8f44-83344720987c" (UID: "d0453ec6-ab6a-4de6-8f44-83344720987c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:42:50.014100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.014074    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0453ec6-ab6a-4de6-8f44-83344720987c-kube-api-access-9cq4g" pod "d0453ec6-ab6a-4de6-8f44-83344720987c" (UID: "d0453ec6-ab6a-4de6-8f44-83344720987c"). InnerVolumeSpecName "kube-api-access-9cq4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:50.014623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.014602    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-metrics-certs" pod "d0453ec6-ab6a-4de6-8f44-83344720987c" (UID: "d0453ec6-ab6a-4de6-8f44-83344720987c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:42:50.023125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.023075    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls" pod "d0453ec6-ab6a-4de6-8f44-83344720987c" (UID: "d0453ec6-ab6a-4de6-8f44-83344720987c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:42:50.110439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.110360    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0453ec6-ab6a-4de6-8f44-83344720987c-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:50.110439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.110400    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:50.110439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.110416    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0453ec6-ab6a-4de6-8f44-83344720987c-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:50.110439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.110430    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9cq4g\" (UniqueName: \"kubernetes.io/projected/d0453ec6-ab6a-4de6-8f44-83344720987c-kube-api-access-9cq4g\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:50.224366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.224301    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:50.570990 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.570944    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:50.833649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.833537    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"
Oct 30 21:42:50.833649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.833586    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522" event={"ID":"d0453ec6-ab6a-4de6-8f44-83344720987c","Type":"ContainerDied","Data":"21885a595a3e0f48f155d05dc3c573dc313ae466bdc41a71e102470586014fbe"}
Oct 30 21:42:50.833649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:50.833649    4943 scope.go:122] "RemoveContainer" containerID="80b67c8a2d8f7aade6aec57a5e73032210b7d6bc83e441ac75e24dbe95ca8cf7"
Oct 30 21:42:51.007589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:51.007536    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"]
Oct 30 21:42:51.051538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:51.051507    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-385396af-59858498cf-qh522"]
Oct 30 21:42:51.068693 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:42:51.068661    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:42:51.211077 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:51.211018    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:51.467514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:51.466725    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:51.622742 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:51.622678    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0453ec6-ab6a-4de6-8f44-83344720987c" path="/var/lib/kubelet/pods/d0453ec6-ab6a-4de6-8f44-83344720987c/volumes"
Oct 30 21:42:51.737203 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:51.737091    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:52.080212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:52.078834    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:52.371884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:52.369205    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:54.558802 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.558652    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:42:54.632300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632268    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-data\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.632488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632372    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-kube-api-access-44bsd\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-kube-api-access-44bsd\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.632488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632463    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-credential-socket\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.632633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632616    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-envoy\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.632691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632670    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/acbab482-85d1-496d-9b85-83911c0feff1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acbab482-85d1-496d-9b85-83911c0feff1-istio-podinfo\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.632748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632720    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/acbab482-85d1-496d-9b85-83911c0feff1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acbab482-85d1-496d-9b85-83911c0feff1-istiod-ca-cert\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.632800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632768    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-socket\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.633404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632868    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-istio-token\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-istio-token\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.633404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.632967    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-certs\") pod \"acbab482-85d1-496d-9b85-83911c0feff1\" (UID: \"acbab482-85d1-496d-9b85-83911c0feff1\") "
Oct 30 21:42:54.633404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.633125    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-data" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:54.633759 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.633642    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.633869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.633837    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-socket" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:54.633945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.633854    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-certs" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:54.634003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.633979    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acbab482-85d1-496d-9b85-83911c0feff1-istiod-ca-cert" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:42:54.634229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.634210    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-credential-socket" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:54.636108 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.636077    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-istio-token" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:54.636230 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.636208    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/acbab482-85d1-496d-9b85-83911c0feff1-istio-podinfo" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:42:54.636230 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.636219    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-kube-api-access-44bsd" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "kube-api-access-44bsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:42:54.636439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.636421    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-envoy" pod "acbab482-85d1-496d-9b85-83911c0feff1" (UID: "acbab482-85d1-496d-9b85-83911c0feff1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:42:54.735663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735626    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.735663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735663    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/acbab482-85d1-496d-9b85-83911c0feff1-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.735925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735679    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/acbab482-85d1-496d-9b85-83911c0feff1-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.735925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735694    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.735925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735708    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.735925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735722    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.735925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735737    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44bsd\" (UniqueName: \"kubernetes.io/projected/acbab482-85d1-496d-9b85-83911c0feff1-kube-api-access-44bsd\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.735925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.735753    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/acbab482-85d1-496d-9b85-83911c0feff1-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:42:54.919504 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.919465    4943 generic.go:356] "Generic (PLEG): container finished" podID="acbab482-85d1-496d-9b85-83911c0feff1" containerID="24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408" exitCode=0
Oct 30 21:42:54.919734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.919532    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"
Oct 30 21:42:54.919734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.919540    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" event={"ID":"acbab482-85d1-496d-9b85-83911c0feff1","Type":"ContainerDied","Data":"24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408"}
Oct 30 21:42:54.919734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.919637    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf" event={"ID":"acbab482-85d1-496d-9b85-83911c0feff1","Type":"ContainerDied","Data":"dc0f1c02f77931d96de7859fceae77f209948238a836c6cb9f257c3e32b12553"}
Oct 30 21:42:54.919734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.919670    4943 scope.go:122] "RemoveContainer" containerID="24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408"
Oct 30 21:42:54.931052 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.931034    4943 scope.go:122] "RemoveContainer" containerID="24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408"
Oct 30 21:42:54.931334 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:42:54.931314    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408\": container with ID starting with 24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408 not found: ID does not exist" containerID="24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408"
Oct 30 21:42:54.931389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:54.931344    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408"} err="failed to get container status \"24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408\": rpc error: code = NotFound desc = could not find container \"24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408\": container with ID starting with 24bbbbbda72e2e60dfd8cb70e14d587012d3cb073e46b5c1d5a8d3a84710e408 not found: ID does not exist"
Oct 30 21:42:55.105666 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:55.105632    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"]
Oct 30 21:42:55.122170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:55.122135    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-bed6793d-openshift-default-649f995d97-2rptf"]
Oct 30 21:42:55.619816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:55.619784    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="acbab482-85d1-496d-9b85-83911c0feff1" path="/var/lib/kubelet/pods/acbab482-85d1-496d-9b85-83911c0feff1/volumes"
Oct 30 21:42:56.301933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:56.301898    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:56.555619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:56.555470    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:57.154243 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:57.153443    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:59.596379 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:59.596344    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:42:59.819848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:42:59.819745    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:00.649616 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:00.644102    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:00.911469 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:00.911369    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:02.445344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:02.445311    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:03.001717 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:03.001681    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:03.252390 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:03.252306    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:04.489047 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:04.489013    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:04.756247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:04.756169    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:07.412366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.412320    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"]
Oct 30 21:43:07.413192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.413166    4943 cpu_manager.go:414] "containerMap: removing container" podUID="d0453ec6-ab6a-4de6-8f44-83344720987c" containerName="maas-api"
Oct 30 21:43:07.413317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.413194    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0453ec6-ab6a-4de6-8f44-83344720987c" containerName="maas-api"
Oct 30 21:43:07.413317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.413254    4943 cpu_manager.go:414] "containerMap: removing container" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy"
Oct 30 21:43:07.413317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.413263    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy"
Oct 30 21:43:07.413472 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.413417    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="acbab482-85d1-496d-9b85-83911c0feff1" containerName="istio-proxy"
Oct 30 21:43:07.413526 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.413437    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0453ec6-ab6a-4de6-8f44-83344720987c" containerName="maas-api"
Oct 30 21:43:07.416889 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.416866    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.499800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.499767    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.499833    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.499973    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jgw\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-kube-api-access-w5jgw\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.500063    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.500206    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.500253    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.500279    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f355dc1-b56d-446f-930c-f15a88a09d8e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.500341    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.500435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.500374    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.601822 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.601786    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.601998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.601838    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.601998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.601855    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f355dc1-b56d-446f-930c-f15a88a09d8e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.601998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.601906    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.601998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.601926    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602237 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602044    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602237 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602097    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602237 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602135    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jgw\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-kube-api-access-w5jgw\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602237 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602223    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602442 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602284    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602649 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602604    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602802 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602708    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.602873 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.602760    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f355dc1-b56d-446f-930c-f15a88a09d8e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.603081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.603060    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.604524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.604504    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.604605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.604574    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.632841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.632810    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"]
Oct 30 21:43:07.661648 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.661619    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.661776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.661724    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jgw\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-kube-api-access-w5jgw\") pod \"maas-default-gateway-openshift-default-7f694df8bc-nb6hp\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.739050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.738955    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:07.755618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.755587    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:07.965071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:07.965033    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:08.237617 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:08.237022    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"]
Oct 30 21:43:08.279068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:08.276993    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:43:08.279068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:08.277082    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:43:08.279068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:08.277125    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:43:09.075667 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:09.075625    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" event={"ID":"8f355dc1-b56d-446f-930c-f15a88a09d8e","Type":"ContainerStarted","Data":"b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c"}
Oct 30 21:43:09.076063 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:09.075718    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" event={"ID":"8f355dc1-b56d-446f-930c-f15a88a09d8e","Type":"ContainerStarted","Data":"90c488a39d9d9993565c934871d65ae3b325538f2635f1be1407f078ebdaa648"}
Oct 30 21:43:09.302593 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:09.302529    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podStartSLOduration=2.302515943 podStartE2EDuration="2.302515943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:09.299320076 +0000 UTC m=+1583.794893426" watchObservedRunningTime="2026-10-30 21:43:09.302515943 +0000 UTC m=+1583.798089293"
Oct 30 21:43:09.740337 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:09.740298    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:09.742101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:09.742074    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:43:09.742234 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:09.742121    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:43:10.740072 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:10.740020    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:43:10.740464 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:10.740093    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:43:11.739611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:11.739576    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:43:11.739798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:11.739640    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:43:12.740610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:12.740572    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:43:12.741000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:12.740629    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:43:13.107228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:13.107131    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:13.740268 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:13.740229    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:43:13.740479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:13.740278    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:43:14.740621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:14.740586    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:43:14.741126 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:14.740642    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:43:15.740317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:15.740278    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Oct 30 21:43:15.740645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:15.740334    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Oct 30 21:43:16.969039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:16.969009    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:16.970902 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:16.970878    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:16.971450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:16.971431    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 21:43:18.087991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:18.087948    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:18.348052 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:18.347926    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:21.088913 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:43:21.088878    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:43:22.516650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.516610    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"]
Oct 30 21:43:22.521348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.521330    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.599570 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.599530    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.599732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.599650    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.599780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.599726    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.599887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.599863    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.599949 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.599933    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck6ww\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-kube-api-access-ck6ww\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.599991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.599977    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7068b329-7a67-4d7e-8cc9-28305feed3ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.600079 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.600065    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.600129 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.600117    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.600291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.600277    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.635112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.635085    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"]
Oct 30 21:43:22.701862 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.701828    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7068b329-7a67-4d7e-8cc9-28305feed3ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.701879    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.701924    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.701998    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702029    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702299 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702077    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702299 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702151    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702299 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702230    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702299 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702283    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck6ww\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-kube-api-access-ck6ww\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702436    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702498    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702748    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7068b329-7a67-4d7e-8cc9-28305feed3ae-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702776    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.702859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.702760    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.704901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.704880    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.705005 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.704981    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.760751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.760719    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck6ww\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-kube-api-access-ck6ww\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.760900 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.760859    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-hdc94\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:22.839176 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:22.839091    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:23.104851 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:23.104707    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:23.288730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:23.288701    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"]
Oct 30 21:43:23.289837 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:43:23.289813    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7068b329_7a67_4d7e_8cc9_28305feed3ae.slice/crio-a17b7f05cd7fb9483ac7d6b0457e33a0ffc2c9ea615e0fed0bff02fd3abb84fa WatchSource:0}: Error finding container a17b7f05cd7fb9483ac7d6b0457e33a0ffc2c9ea615e0fed0bff02fd3abb84fa: Status 404 returned error can't find the container with id a17b7f05cd7fb9483ac7d6b0457e33a0ffc2c9ea615e0fed0bff02fd3abb84fa
Oct 30 21:43:23.292784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:23.292751    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:43:23.292889 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:23.292817    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:43:23.292889 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:23.292865    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:43:24.236603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:24.235614    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" event={"ID":"7068b329-7a67-4d7e-8cc9-28305feed3ae","Type":"ContainerStarted","Data":"0ef001c88007a179c89716a816813e62da8ed48e7fac41d67e2ff7b4af73df35"}
Oct 30 21:43:24.236603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:24.235686    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" event={"ID":"7068b329-7a67-4d7e-8cc9-28305feed3ae","Type":"ContainerStarted","Data":"a17b7f05cd7fb9483ac7d6b0457e33a0ffc2c9ea615e0fed0bff02fd3abb84fa"}
Oct 30 21:43:24.463514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:24.463425    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podStartSLOduration=2.463392365 podStartE2EDuration="2.463392365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:24.40723746 +0000 UTC m=+1598.902810810" watchObservedRunningTime="2026-10-30 21:43:24.463392365 +0000 UTC m=+1598.958965717"
Oct 30 21:43:24.839957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:24.839926    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:24.841010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:24.840984    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:43:24.841144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:24.841030    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:43:25.840597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:25.840540    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:43:25.840979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:25.840622    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:43:26.839949 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:26.839915    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:43:26.840139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:26.839974    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:43:27.839927 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:27.839891    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:43:27.840317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:27.839952    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:43:28.109628 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:28.109129    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:28.839913 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:28.839877    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:43:28.840102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:28.839948    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:43:29.840254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:29.840219    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:43:29.840740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:29.840280    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:43:30.839777 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:30.839746    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Oct 30 21:43:30.839975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:30.839813    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Oct 30 21:43:32.410291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:32.410251    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:32.411058 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:32.411034    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:32.411808 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:32.411790    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 21:43:33.101578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:33.095099    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:38.400420 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:38.400383    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:42.990068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:42.990010    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"]
Oct 30 21:43:42.994652 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:42.994628    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.046516 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.046487    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-metrics-certs\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.046701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.046680    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8x9j\" (UniqueName: \"kubernetes.io/projected/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-kube-api-access-z8x9j\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.046923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.046893    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-openshift-service-ca\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.047030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.046944    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.049484 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.049460    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9173600a-serving-cert\""
Oct 30 21:43:43.101933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.101898    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"]
Oct 30 21:43:43.148524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.148484    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8x9j\" (UniqueName: \"kubernetes.io/projected/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-kube-api-access-z8x9j\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.149344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.148736    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-openshift-service-ca\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.149344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.148782    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.149344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.148889    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-metrics-certs\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.153699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.153678    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-openshift-service-ca\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.153854 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:43:43.153700    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-serving-cert: secret "maas-api-e2e-ait-9173600a-serving-cert" not found
Oct 30 21:43:43.154008 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:43:43.153987    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls podName:c07f68d0-1b7c-4c23-ae3c-03ed67da3a88 nodeName:}" failed. No retries permitted until 2026-10-30 21:43:43.653963801 +0000 UTC m=+1618.149537145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls") pod "maas-api-e2e-ait-9173600a-79545757dd-mlg4b" (UID: "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88") : secret "maas-api-e2e-ait-9173600a-serving-cert" not found
Oct 30 21:43:43.156183 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.156159    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-metrics-certs\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.212180 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.212147    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8x9j\" (UniqueName: \"kubernetes.io/projected/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-kube-api-access-z8x9j\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.278984 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.277711    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:43.516289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.516249    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:43.667654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.667626    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.670364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.670330    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls\") pod \"maas-api-e2e-ait-9173600a-79545757dd-mlg4b\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:43.909244 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:43.909211    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:44.303626 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:44.303591    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"]
Oct 30 21:43:44.305811 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:43:44.305778    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc07f68d0_1b7c_4c23_ae3c_03ed67da3a88.slice/crio-9f464a16238a42eccea15cb578d8c892367ee1f1d02fadb877a4b59f8994a371 WatchSource:0}: Error finding container 9f464a16238a42eccea15cb578d8c892367ee1f1d02fadb877a4b59f8994a371: Status 404 returned error can't find the container with id 9f464a16238a42eccea15cb578d8c892367ee1f1d02fadb877a4b59f8994a371
Oct 30 21:43:44.522851 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:44.522821    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b" event={"ID":"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88","Type":"ContainerStarted","Data":"9f464a16238a42eccea15cb578d8c892367ee1f1d02fadb877a4b59f8994a371"}
Oct 30 21:43:45.209092 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:45.209066    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:45.532790 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:45.532751    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b" event={"ID":"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88","Type":"ContainerStarted","Data":"0d1ee2d32c792ca44deb82e60b4987b2d615bb30518e230096f9bfeade94d8ba"}
Oct 30 21:43:45.533318 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:45.532921    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:45.660127 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:45.660066    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b" podStartSLOduration=2.852192798 podStartE2EDuration="3.660048195s" totalImagesPullingTime="807.855397ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:43:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:43:45.653738235 +0000 UTC m=+1620.149311585" watchObservedRunningTime="2026-10-30 21:43:45.660048195 +0000 UTC m=+1620.155621547"
Oct 30 21:43:46.402699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:46.402669    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:47.104575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:47.084409    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:47.508657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:47.508622    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:48.534305 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:48.534236    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:48.905757 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:48.905724    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:49.641705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:49.639835    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:50.090377 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:50.090333    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:51.078268 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:43:51.078229    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:43:51.551144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:51.551116    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:43:52.256920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:52.256870    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:52.490843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:52.490798    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:53.809066 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:53.809025    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:55.831493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:55.831462    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:56.045578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:56.045527    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:58.745659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:58.745618    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:58.932720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:58.932674    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:43:59.978461 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:43:59.978426    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:02.047391 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:02.047358    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"]
Oct 30 21:44:02.096856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:02.096828    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d7a88777-m9v7t"]
Oct 30 21:44:03.256339 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:03.256299    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:03.506954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:03.506873    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:03.620183 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:03.620150    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5feef019-756c-496c-b0bf-efb12fc31596" path="/var/lib/kubelet/pods/5feef019-756c-496c-b0bf-efb12fc31596/volumes"
Oct 30 21:44:03.970912 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:03.970793    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:07.000832 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:07.000794    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:07.184695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:07.184647    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:09.406490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:09.406431    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:14.460862 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:14.460791    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:19.837384 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:19.837343    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:21.064478 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:44:21.064431    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:44:23.890245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:23.890204    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:24.931142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:24.931099    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:25.608136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:25.608101    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:25.943792 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:25.943758    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:30.010383 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:30.010011    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:30.193848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:30.193815    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:34.821371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:34.821307    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:36.473792 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.473752    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"]
Oct 30 21:44:36.480008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.479097    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.555164 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.555119    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"]
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607113    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c715a6d-46b0-4817-b8b2-18352dd63802-istiod-ca-cert\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607173    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-envoy\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607226    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-data\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607274    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-token\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607429    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-certs\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607576    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-podinfo\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607604    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c27kt\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-kube-api-access-c27kt\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607634    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-credential-socket\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.607944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.607673    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-socket\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.625726 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.622926    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w0-d6a241-openshift-default-dockercfg-vkrb4\""
Oct 30 21:44:36.649637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.649547    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:36.715057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.715003    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-token\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.715456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.715429    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-certs\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.715744 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.715724    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-podinfo\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.715891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.715875    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c27kt\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-kube-api-access-c27kt\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.715996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.715982    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-credential-socket\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.716110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.716095    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-socket\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.716324 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.716294    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c715a6d-46b0-4817-b8b2-18352dd63802-istiod-ca-cert\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.716460 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.716432    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-envoy\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.716625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.716610    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-data\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.718096 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.718071    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-data\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.718916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.718875    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-credential-socket\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.719366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.719322    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-certs\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.729701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.719912    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-socket\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.729701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.720314    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c715a6d-46b0-4817-b8b2-18352dd63802-istiod-ca-cert\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.729701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.729136    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-envoy\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.730505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.730457    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-podinfo\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.779578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.777065    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-token\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.786608 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.786315    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c27kt\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-kube-api-access-c27kt\") pod \"e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") " pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.861648 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.857216    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:36.903380 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:36.903279    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:37.356354 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:44:37.355338    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c715a6d_46b0_4817_b8b2_18352dd63802.slice/crio-f6e91923b74b5405095cccfe4ef68cfb766689e3aca0358890a41ac5e25dbe44 WatchSource:0}: Error finding container f6e91923b74b5405095cccfe4ef68cfb766689e3aca0358890a41ac5e25dbe44: Status 404 returned error can't find the container with id f6e91923b74b5405095cccfe4ef68cfb766689e3aca0358890a41ac5e25dbe44
Oct 30 21:44:37.357465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:37.357436    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"]
Oct 30 21:44:37.358788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:37.358755    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:44:37.358891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:37.358831    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:44:37.358891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:37.358874    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:44:38.146631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:38.146597    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" event={"ID":"8c715a6d-46b0-4817-b8b2-18352dd63802","Type":"ContainerStarted","Data":"9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7"}
Oct 30 21:44:38.147051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:38.146654    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" event={"ID":"8c715a6d-46b0-4817-b8b2-18352dd63802","Type":"ContainerStarted","Data":"f6e91923b74b5405095cccfe4ef68cfb766689e3aca0358890a41ac5e25dbe44"}
Oct 30 21:44:38.321323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:38.321266    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podStartSLOduration=2.321252595 podStartE2EDuration="2.321252595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:38.317371532 +0000 UTC m=+1672.812944883" watchObservedRunningTime="2026-10-30 21:44:38.321252595 +0000 UTC m=+1672.816825946"
Oct 30 21:44:38.844290 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:38.844259    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:38.850536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:38.850510    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:39.154366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:39.154338    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:39.155391 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:39.155365    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:44:39.711542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:39.711507    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:41.189202 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:41.189166    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:41.409691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:41.409649    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:41.615973 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:41.615857    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:43.339828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:43.339795    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:44.631110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:44.631077    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:44.831579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:44.829063    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:45.254885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:45.250808    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:45.614347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:45.614252    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:49.814477 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:49.814424    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:50.257881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.257847    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"]
Oct 30 21:44:50.263967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.263944    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.318652 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.318624    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"]
Oct 30 21:44:50.339407 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.339380    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q4x6\" (UniqueName: \"kubernetes.io/projected/59229a70-7f76-4df9-b52c-93ff26d3aac4-kube-api-access-8q4x6\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.339589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.339428    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59229a70-7f76-4df9-b52c-93ff26d3aac4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.339812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.339787    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.339928 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.339909    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.361837 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.361811    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w1-2ace1d-serving-cert\""
Oct 30 21:44:50.441148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.441115    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q4x6\" (UniqueName: \"kubernetes.io/projected/59229a70-7f76-4df9-b52c-93ff26d3aac4-kube-api-access-8q4x6\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.441317 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.441256    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59229a70-7f76-4df9-b52c-93ff26d3aac4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.441571 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.441534    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.441671 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:44:50.441642    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-serving-cert: secret "maas-api-e2e-shared-a-w1-2ace1d-serving-cert" not found
Oct 30 21:44:50.441671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.441660    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.441799 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:44:50.441708    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls podName:59229a70-7f76-4df9-b52c-93ff26d3aac4 nodeName:}" failed. No retries permitted until 2026-10-30 21:44:50.941691547 +0000 UTC m=+1685.437264876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls") pod "maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst" (UID: "59229a70-7f76-4df9-b52c-93ff26d3aac4") : secret "maas-api-e2e-shared-a-w1-2ace1d-serving-cert" not found
Oct 30 21:44:50.442023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.442001    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59229a70-7f76-4df9-b52c-93ff26d3aac4-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.444570 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.444538    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-metrics-certs\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.492691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.492621    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:50.520748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.520636    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q4x6\" (UniqueName: \"kubernetes.io/projected/59229a70-7f76-4df9-b52c-93ff26d3aac4-kube-api-access-8q4x6\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.695492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.695449    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:50.886345 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.886263    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:50.950401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.950368    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:50.952891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:50.952870    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls\") pod \"maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:51.070615 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:44:51.070574    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:44:51.181823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:51.181787    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:51.581051 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:44:51.581019    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59229a70_7f76_4df9_b52c_93ff26d3aac4.slice/crio-2108805c3dd213b8b3c740acb97c3a9d33fd5a26b247735d4b303c201e6f91b9 WatchSource:0}: Error finding container 2108805c3dd213b8b3c740acb97c3a9d33fd5a26b247735d4b303c201e6f91b9: Status 404 returned error can't find the container with id 2108805c3dd213b8b3c740acb97c3a9d33fd5a26b247735d4b303c201e6f91b9
Oct 30 21:44:51.582148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:51.582026    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"]
Oct 30 21:44:51.583066 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:51.583044    4943 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:44:52.407735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:52.407700    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst" event={"ID":"59229a70-7f76-4df9-b52c-93ff26d3aac4","Type":"ContainerStarted","Data":"2108805c3dd213b8b3c740acb97c3a9d33fd5a26b247735d4b303c201e6f91b9"}
Oct 30 21:44:53.416625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:53.416592    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst" event={"ID":"59229a70-7f76-4df9-b52c-93ff26d3aac4","Type":"ContainerStarted","Data":"1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707"}
Oct 30 21:44:53.419275 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:53.416809    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:44:53.533873 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:53.533823    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst" podStartSLOduration=2.723269865 podStartE2EDuration="3.533809471s" totalImagesPullingTime="810.539606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:44:53.529881954 +0000 UTC m=+1688.025455327" watchObservedRunningTime="2026-10-30 21:44:53.533809471 +0000 UTC m=+1688.029382822"
Oct 30 21:44:56.216581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:56.213335    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:44:59.432070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:44:59.432037    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:45:00.317752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.317718    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"]
Oct 30 21:45:00.322609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.322580    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"]
Oct 30 21:45:00.322769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.322657    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.327485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.327463    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:00.346201 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.344525    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"]
Oct 30 21:45:00.352410 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.352342    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.407510 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.406757    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"]
Oct 30 21:45:00.411289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.410196    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0afe86-16a4-40c9-b817-e96af25f909d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.411669 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.411639    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9v8\" (UniqueName: \"kubernetes.io/projected/2e0afe86-16a4-40c9-b817-e96af25f909d-kube-api-access-wm9v8\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.412731 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.412708    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"]
Oct 30 21:45:00.438010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.437984    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6t2c7\""
Oct 30 21:45:00.444427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.442544    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"]
Oct 30 21:45:00.513033 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.513004    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9v8\" (UniqueName: \"kubernetes.io/projected/2e0afe86-16a4-40c9-b817-e96af25f909d-kube-api-access-wm9v8\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.513195 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.513068    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zd6\" (UniqueName: \"kubernetes.io/projected/461ff178-e338-4cb9-801a-447e97afaf3f-kube-api-access-99zd6\") pod \"maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:00.513254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.513218    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.513360 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.513344    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gsmn\" (UniqueName: \"kubernetes.io/projected/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-kube-api-access-4gsmn\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.513405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.513389    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0afe86-16a4-40c9-b817-e96af25f909d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.513453 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.513441    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/461ff178-e338-4cb9-801a-447e97afaf3f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:00.514073 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.514056    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0afe86-16a4-40c9-b817-e96af25f909d-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.572520 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.572448    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9v8\" (UniqueName: \"kubernetes.io/projected/2e0afe86-16a4-40c9-b817-e96af25f909d-kube-api-access-wm9v8\") pod \"maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.614522 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.614485    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zd6\" (UniqueName: \"kubernetes.io/projected/461ff178-e338-4cb9-801a-447e97afaf3f-kube-api-access-99zd6\") pod \"maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:00.614695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.614624    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.614695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.614692    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gsmn\" (UniqueName: \"kubernetes.io/projected/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-kube-api-access-4gsmn\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.614818 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.614742    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/461ff178-e338-4cb9-801a-447e97afaf3f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:00.615264 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.615241    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.615404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.615385    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/461ff178-e338-4cb9-801a-447e97afaf3f-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:00.642885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.642858    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:00.672311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.672285    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gsmn\" (UniqueName: \"kubernetes.io/projected/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-kube-api-access-4gsmn\") pod \"maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.673012 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.672990    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zd6\" (UniqueName: \"kubernetes.io/projected/461ff178-e338-4cb9-801a-447e97afaf3f-kube-api-access-99zd6\") pod \"maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:00.715129 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.714840    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:00.970143 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:00.970107    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:01.035523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.035497    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"]
Oct 30 21:45:01.116353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.116322    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:01.139161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.139132    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"]
Oct 30 21:45:01.140934 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:45:01.140911    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f4cd45b_1cf9_455a_95fc_1cba7ca18d70.slice/crio-3809aef597b668530814a464985c7e07e9637fe734e4b6fd4de4f8d166327b68 WatchSource:0}: Error finding container 3809aef597b668530814a464985c7e07e9637fe734e4b6fd4de4f8d166327b68: Status 404 returned error can't find the container with id 3809aef597b668530814a464985c7e07e9637fe734e4b6fd4de4f8d166327b68
Oct 30 21:45:01.341679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.341648    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:01.378378 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.378350    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"]
Oct 30 21:45:01.446493 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:45:01.446459    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod461ff178_e338_4cb9_801a_447e97afaf3f.slice/crio-9c59f179172a3fda0f8434c91cfb8d872665b65d1eb92322052f13e3e7d23ce2 WatchSource:0}: Error finding container 9c59f179172a3fda0f8434c91cfb8d872665b65d1eb92322052f13e3e7d23ce2: Status 404 returned error can't find the container with id 9c59f179172a3fda0f8434c91cfb8d872665b65d1eb92322052f13e3e7d23ce2
Oct 30 21:45:01.527501 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.527467    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:01.549636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.549608    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" event={"ID":"2e0afe86-16a4-40c9-b817-e96af25f909d","Type":"ContainerStarted","Data":"fd48a4ea2ac387f191c80b4b496185d5bf99d36779235e1ac5b9fa8ca02c3ce7"}
Oct 30 21:45:01.553443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.553414    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" event={"ID":"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70","Type":"ContainerStarted","Data":"3809aef597b668530814a464985c7e07e9637fe734e4b6fd4de4f8d166327b68"}
Oct 30 21:45:01.555443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:01.555418    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" event={"ID":"461ff178-e338-4cb9-801a-447e97afaf3f","Type":"ContainerStarted","Data":"9c59f179172a3fda0f8434c91cfb8d872665b65d1eb92322052f13e3e7d23ce2"}
Oct 30 21:45:02.581654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.581618    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" event={"ID":"461ff178-e338-4cb9-801a-447e97afaf3f","Type":"ContainerStarted","Data":"54ad982d2c5110279e846727d85ea3db1a06bb30f34a8addc76ac07e8ea2471d"}
Oct 30 21:45:02.586120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.586087    4943 generic.go:356] "Generic (PLEG): container finished" podID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerID="25ad8fc65f7bc759d928a9a52ff404522643e075515bb4e548c54efa4e08687c" exitCode=60
Oct 30 21:45:02.586582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.586448    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" event={"ID":"2e0afe86-16a4-40c9-b817-e96af25f909d","Type":"ContainerDied","Data":"25ad8fc65f7bc759d928a9a52ff404522643e075515bb4e548c54efa4e08687c"}
Oct 30 21:45:02.587291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.587271    4943 scope.go:122] "RemoveContainer" containerID="25ad8fc65f7bc759d928a9a52ff404522643e075515bb4e548c54efa4e08687c"
Oct 30 21:45:02.592176 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.592149    4943 generic.go:356] "Generic (PLEG): container finished" podID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerID="47e4ba13385edc9fdccd47ba383a80f40f379dc4ea6db4be693779be1522e139" exitCode=60
Oct 30 21:45:02.592500 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.592481    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" event={"ID":"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70","Type":"ContainerDied","Data":"47e4ba13385edc9fdccd47ba383a80f40f379dc4ea6db4be693779be1522e139"}
Oct 30 21:45:02.593094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.593077    4943 scope.go:122] "RemoveContainer" containerID="47e4ba13385edc9fdccd47ba383a80f40f379dc4ea6db4be693779be1522e139"
Oct 30 21:45:02.713095 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:02.712983    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" podStartSLOduration=2.7129622319999998 podStartE2EDuration="2.712962232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:02.696912548 +0000 UTC m=+1697.192485901" watchObservedRunningTime="2026-10-30 21:45:02.712962232 +0000 UTC m=+1697.208535586"
Oct 30 21:45:03.602684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.602654    4943 generic.go:356] "Generic (PLEG): container finished" podID="461ff178-e338-4cb9-801a-447e97afaf3f" containerID="54ad982d2c5110279e846727d85ea3db1a06bb30f34a8addc76ac07e8ea2471d" exitCode=60
Oct 30 21:45:03.603111 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.602726    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" event={"ID":"461ff178-e338-4cb9-801a-447e97afaf3f","Type":"ContainerDied","Data":"54ad982d2c5110279e846727d85ea3db1a06bb30f34a8addc76ac07e8ea2471d"}
Oct 30 21:45:03.603111 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.603062    4943 scope.go:122] "RemoveContainer" containerID="54ad982d2c5110279e846727d85ea3db1a06bb30f34a8addc76ac07e8ea2471d"
Oct 30 21:45:03.604913 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.604895    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" event={"ID":"2e0afe86-16a4-40c9-b817-e96af25f909d","Type":"ContainerStarted","Data":"e9cea19eabbd1aba0a00397ad2ee6ea6347a7f960bdaedcd102c4bb0f3611a4a"}
Oct 30 21:45:03.606900 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.606882    4943 generic.go:356] "Generic (PLEG): container finished" podID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerID="fdf56de05a23ee9b72c956d7beb5595bca2802f5e5108f36e90d1ce0b5a80360" exitCode=60
Oct 30 21:45:03.607004 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.606912    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" event={"ID":"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70","Type":"ContainerDied","Data":"fdf56de05a23ee9b72c956d7beb5595bca2802f5e5108f36e90d1ce0b5a80360"}
Oct 30 21:45:03.607004 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.606947    4943 scope.go:122] "RemoveContainer" containerID="47e4ba13385edc9fdccd47ba383a80f40f379dc4ea6db4be693779be1522e139"
Oct 30 21:45:03.607266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.607246    4943 scope.go:122] "RemoveContainer" containerID="fdf56de05a23ee9b72c956d7beb5595bca2802f5e5108f36e90d1ce0b5a80360"
Oct 30 21:45:03.607493 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:03.607469    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l_odh-ai-gateway-infra(2f4cd45b-1cf9-455a-95fc-1cba7ca18d70)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70"
Oct 30 21:45:03.948595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:03.948520    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" podStartSLOduration=3.948503476 podStartE2EDuration="3.948503476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:45:03.94566776 +0000 UTC m=+1698.441241108" watchObservedRunningTime="2026-10-30 21:45:03.948503476 +0000 UTC m=+1698.444076829"
Oct 30 21:45:04.616503 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.616465    4943 generic.go:356] "Generic (PLEG): container finished" podID="461ff178-e338-4cb9-801a-447e97afaf3f" containerID="f62b9f3d30fbb5551ae4f06102170c2039da6902cd0550afdcb6474b6ab05f95" exitCode=60
Oct 30 21:45:04.616944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.616593    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" event={"ID":"461ff178-e338-4cb9-801a-447e97afaf3f","Type":"ContainerDied","Data":"f62b9f3d30fbb5551ae4f06102170c2039da6902cd0550afdcb6474b6ab05f95"}
Oct 30 21:45:04.616944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.616651    4943 scope.go:122] "RemoveContainer" containerID="54ad982d2c5110279e846727d85ea3db1a06bb30f34a8addc76ac07e8ea2471d"
Oct 30 21:45:04.616944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.616876    4943 scope.go:122] "RemoveContainer" containerID="f62b9f3d30fbb5551ae4f06102170c2039da6902cd0550afdcb6474b6ab05f95"
Oct 30 21:45:04.617229 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:04.617204    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq_odh-ai-gateway-infra(461ff178-e338-4cb9-801a-447e97afaf3f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" podUID="461ff178-e338-4cb9-801a-447e97afaf3f"
Oct 30 21:45:04.618811 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.618789    4943 generic.go:356] "Generic (PLEG): container finished" podID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerID="e9cea19eabbd1aba0a00397ad2ee6ea6347a7f960bdaedcd102c4bb0f3611a4a" exitCode=60
Oct 30 21:45:04.618913 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.618869    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" event={"ID":"2e0afe86-16a4-40c9-b817-e96af25f909d","Type":"ContainerDied","Data":"e9cea19eabbd1aba0a00397ad2ee6ea6347a7f960bdaedcd102c4bb0f3611a4a"}
Oct 30 21:45:04.619106 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.619092    4943 scope.go:122] "RemoveContainer" containerID="e9cea19eabbd1aba0a00397ad2ee6ea6347a7f960bdaedcd102c4bb0f3611a4a"
Oct 30 21:45:04.619394 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:04.619375    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt_odh-ai-gateway-infra(2e0afe86-16a4-40c9-b817-e96af25f909d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d"
Oct 30 21:45:04.620770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.620752    4943 scope.go:122] "RemoveContainer" containerID="fdf56de05a23ee9b72c956d7beb5595bca2802f5e5108f36e90d1ce0b5a80360"
Oct 30 21:45:04.621008 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:04.620988    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l_odh-ai-gateway-infra(2f4cd45b-1cf9-455a-95fc-1cba7ca18d70)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70"
Oct 30 21:45:04.630475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:04.630447    4943 scope.go:122] "RemoveContainer" containerID="25ad8fc65f7bc759d928a9a52ff404522643e075515bb4e548c54efa4e08687c"
Oct 30 21:45:05.630625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:05.630591    4943 scope.go:122] "RemoveContainer" containerID="e9cea19eabbd1aba0a00397ad2ee6ea6347a7f960bdaedcd102c4bb0f3611a4a"
Oct 30 21:45:05.631097 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:05.630905    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt_odh-ai-gateway-infra(2e0afe86-16a4-40c9-b817-e96af25f909d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d"
Oct 30 21:45:05.632414 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:05.632392    4943 scope.go:122] "RemoveContainer" containerID="f62b9f3d30fbb5551ae4f06102170c2039da6902cd0550afdcb6474b6ab05f95"
Oct 30 21:45:05.632683 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:05.632660    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq_odh-ai-gateway-infra(461ff178-e338-4cb9-801a-447e97afaf3f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" podUID="461ff178-e338-4cb9-801a-447e97afaf3f"
Oct 30 21:45:05.938050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:05.938006    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:06.133219 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:06.133182    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:11.332952 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:11.332904    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:14.611933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:14.611587    4943 scope.go:122] "RemoveContainer" containerID="e9cea19eabbd1aba0a00397ad2ee6ea6347a7f960bdaedcd102c4bb0f3611a4a"
Oct 30 21:45:14.611933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:14.611719    4943 scope.go:122] "RemoveContainer" containerID="fdf56de05a23ee9b72c956d7beb5595bca2802f5e5108f36e90d1ce0b5a80360"
Oct 30 21:45:15.616748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:15.616620    4943 scope.go:122] "RemoveContainer" containerID="f62b9f3d30fbb5551ae4f06102170c2039da6902cd0550afdcb6474b6ab05f95"
Oct 30 21:45:15.713129 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:15.713093    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" event={"ID":"2e0afe86-16a4-40c9-b817-e96af25f909d","Type":"ContainerStarted","Data":"f9957cce19e124a0347b2ebbe7fd4be1854e579faf5aba65ae5442dc83963c89"}
Oct 30 21:45:15.715250 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:15.715214    4943 generic.go:356] "Generic (PLEG): container finished" podID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerID="62d725582fe033d038cc227d2d10de76c46f5c68d8181a3ec99a8636ccfb9ad7" exitCode=60
Oct 30 21:45:15.715368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:15.715281    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" event={"ID":"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70","Type":"ContainerDied","Data":"62d725582fe033d038cc227d2d10de76c46f5c68d8181a3ec99a8636ccfb9ad7"}
Oct 30 21:45:15.715368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:15.715340    4943 scope.go:122] "RemoveContainer" containerID="fdf56de05a23ee9b72c956d7beb5595bca2802f5e5108f36e90d1ce0b5a80360"
Oct 30 21:45:15.716488 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:15.715715    4943 scope.go:122] "RemoveContainer" containerID="62d725582fe033d038cc227d2d10de76c46f5c68d8181a3ec99a8636ccfb9ad7"
Oct 30 21:45:15.716488 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:15.716111    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l_odh-ai-gateway-infra(2f4cd45b-1cf9-455a-95fc-1cba7ca18d70)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70"
Oct 30 21:45:16.105683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.105147    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:16.724768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.724688    4943 generic.go:356] "Generic (PLEG): container finished" podID="461ff178-e338-4cb9-801a-447e97afaf3f" containerID="ced08b5011b596175a156b441f4c1c959dd5922390cc5cf1df7a1d5e7678dd5e" exitCode=60
Oct 30 21:45:16.724768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.724759    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" event={"ID":"461ff178-e338-4cb9-801a-447e97afaf3f","Type":"ContainerDied","Data":"ced08b5011b596175a156b441f4c1c959dd5922390cc5cf1df7a1d5e7678dd5e"}
Oct 30 21:45:16.725205 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.724814    4943 scope.go:122] "RemoveContainer" containerID="f62b9f3d30fbb5551ae4f06102170c2039da6902cd0550afdcb6474b6ab05f95"
Oct 30 21:45:16.725267 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.725250    4943 scope.go:122] "RemoveContainer" containerID="ced08b5011b596175a156b441f4c1c959dd5922390cc5cf1df7a1d5e7678dd5e"
Oct 30 21:45:16.725681 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:16.725656    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq_odh-ai-gateway-infra(461ff178-e338-4cb9-801a-447e97afaf3f)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" podUID="461ff178-e338-4cb9-801a-447e97afaf3f"
Oct 30 21:45:16.726910 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.726887    4943 generic.go:356] "Generic (PLEG): container finished" podID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerID="f9957cce19e124a0347b2ebbe7fd4be1854e579faf5aba65ae5442dc83963c89" exitCode=60
Oct 30 21:45:16.727003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.726961    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" event={"ID":"2e0afe86-16a4-40c9-b817-e96af25f909d","Type":"ContainerDied","Data":"f9957cce19e124a0347b2ebbe7fd4be1854e579faf5aba65ae5442dc83963c89"}
Oct 30 21:45:16.727351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.727335    4943 scope.go:122] "RemoveContainer" containerID="f9957cce19e124a0347b2ebbe7fd4be1854e579faf5aba65ae5442dc83963c89"
Oct 30 21:45:16.727746 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:16.727725    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt_odh-ai-gateway-infra(2e0afe86-16a4-40c9-b817-e96af25f909d)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d"
Oct 30 21:45:16.738016 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.737998    4943 scope.go:122] "RemoveContainer" containerID="e9cea19eabbd1aba0a00397ad2ee6ea6347a7f960bdaedcd102c4bb0f3611a4a"
Oct 30 21:45:16.842596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.842520    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"]
Oct 30 21:45:16.955751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:16.955724    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"]
Oct 30 21:45:17.158767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.158741    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:17.286001 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.285922    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-kube-api-access-4gsmn\" (UniqueName: \"kubernetes.io/projected/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-kube-api-access-4gsmn\") pod \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") "
Oct 30 21:45:17.286545 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.286292    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-maas-api-service-ca\") pod \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\" (UID: \"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70\") "
Oct 30 21:45:17.286881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.286851    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-maas-api-service-ca" pod "2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" (UID: "2f4cd45b-1cf9-455a-95fc-1cba7ca18d70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:17.288610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.288550    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-kube-api-access-4gsmn" pod "2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" (UID: "2f4cd45b-1cf9-455a-95fc-1cba7ca18d70"). InnerVolumeSpecName "kube-api-access-4gsmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:17.388245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.388205    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gsmn\" (UniqueName: \"kubernetes.io/projected/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-kube-api-access-4gsmn\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:17.388245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.388240    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:17.737295 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.737271    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"
Oct 30 21:45:17.737756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.737270    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l" event={"ID":"2f4cd45b-1cf9-455a-95fc-1cba7ca18d70","Type":"ContainerDied","Data":"3809aef597b668530814a464985c7e07e9637fe734e4b6fd4de4f8d166327b68"}
Oct 30 21:45:17.737756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.737399    4943 scope.go:122] "RemoveContainer" containerID="62d725582fe033d038cc227d2d10de76c46f5c68d8181a3ec99a8636ccfb9ad7"
Oct 30 21:45:17.862532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.862084    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"]
Oct 30 21:45:17.931602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:17.931341    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:18.021254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.021220    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"]
Oct 30 21:45:18.037269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.037242    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w0-3b21b4-29889945-6xl5l"]
Oct 30 21:45:18.039057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.039026    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:18.100871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.100846    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e0afe86-16a4-40c9-b817-e96af25f909d-kube-api-access-wm9v8\" (UniqueName: \"kubernetes.io/projected/2e0afe86-16a4-40c9-b817-e96af25f909d-kube-api-access-wm9v8\") pod \"2e0afe86-16a4-40c9-b817-e96af25f909d\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") "
Oct 30 21:45:18.101005 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.100992    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e0afe86-16a4-40c9-b817-e96af25f909d-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0afe86-16a4-40c9-b817-e96af25f909d-maas-api-service-ca\") pod \"2e0afe86-16a4-40c9-b817-e96af25f909d\" (UID: \"2e0afe86-16a4-40c9-b817-e96af25f909d\") "
Oct 30 21:45:18.101365 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.101336    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e0afe86-16a4-40c9-b817-e96af25f909d-maas-api-service-ca" pod "2e0afe86-16a4-40c9-b817-e96af25f909d" (UID: "2e0afe86-16a4-40c9-b817-e96af25f909d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:18.101547 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.101532    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2e0afe86-16a4-40c9-b817-e96af25f909d-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:18.103028 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.103007    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e0afe86-16a4-40c9-b817-e96af25f909d-kube-api-access-wm9v8" pod "2e0afe86-16a4-40c9-b817-e96af25f909d" (UID: "2e0afe86-16a4-40c9-b817-e96af25f909d"). InnerVolumeSpecName "kube-api-access-wm9v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:18.203039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.203013    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/461ff178-e338-4cb9-801a-447e97afaf3f-kube-api-access-99zd6\" (UniqueName: \"kubernetes.io/projected/461ff178-e338-4cb9-801a-447e97afaf3f-kube-api-access-99zd6\") pod \"461ff178-e338-4cb9-801a-447e97afaf3f\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") "
Oct 30 21:45:18.203179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.203092    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/461ff178-e338-4cb9-801a-447e97afaf3f-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/461ff178-e338-4cb9-801a-447e97afaf3f-maas-api-service-ca\") pod \"461ff178-e338-4cb9-801a-447e97afaf3f\" (UID: \"461ff178-e338-4cb9-801a-447e97afaf3f\") "
Oct 30 21:45:18.203432 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.203407    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/461ff178-e338-4cb9-801a-447e97afaf3f-maas-api-service-ca" pod "461ff178-e338-4cb9-801a-447e97afaf3f" (UID: "461ff178-e338-4cb9-801a-447e97afaf3f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:18.203568 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.203542    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9v8\" (UniqueName: \"kubernetes.io/projected/2e0afe86-16a4-40c9-b817-e96af25f909d-kube-api-access-wm9v8\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:18.203618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.203571    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/461ff178-e338-4cb9-801a-447e97afaf3f-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:18.205102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.205082    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461ff178-e338-4cb9-801a-447e97afaf3f-kube-api-access-99zd6" pod "461ff178-e338-4cb9-801a-447e97afaf3f" (UID: "461ff178-e338-4cb9-801a-447e97afaf3f"). InnerVolumeSpecName "kube-api-access-99zd6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:18.305267 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.305228    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99zd6\" (UniqueName: \"kubernetes.io/projected/461ff178-e338-4cb9-801a-447e97afaf3f-kube-api-access-99zd6\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:18.750229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.750202    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"
Oct 30 21:45:18.750753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.750226    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt" event={"ID":"2e0afe86-16a4-40c9-b817-e96af25f909d","Type":"ContainerDied","Data":"fd48a4ea2ac387f191c80b4b496185d5bf99d36779235e1ac5b9fa8ca02c3ce7"}
Oct 30 21:45:18.750753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.750298    4943 scope.go:122] "RemoveContainer" containerID="f9957cce19e124a0347b2ebbe7fd4be1854e579faf5aba65ae5442dc83963c89"
Oct 30 21:45:18.753636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.753581    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq" event={"ID":"461ff178-e338-4cb9-801a-447e97afaf3f","Type":"ContainerDied","Data":"9c59f179172a3fda0f8434c91cfb8d872665b65d1eb92322052f13e3e7d23ce2"}
Oct 30 21:45:18.753770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.753621    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"
Oct 30 21:45:18.762825 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.762648    4943 scope.go:122] "RemoveContainer" containerID="ced08b5011b596175a156b441f4c1c959dd5922390cc5cf1df7a1d5e7678dd5e"
Oct 30 21:45:18.919098 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.919059    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"]
Oct 30 21:45:18.929900 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.929873    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-9173600a-29889945-nlxvq"]
Oct 30 21:45:18.938551 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:18.938525    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:19.037231 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:19.037151    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"]
Oct 30 21:45:19.041494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:19.041469    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-1b5b5f-29889945-g7jbt"]
Oct 30 21:45:19.621711 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:19.621679    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" path="/var/lib/kubelet/pods/2e0afe86-16a4-40c9-b817-e96af25f909d/volumes"
Oct 30 21:45:19.622190 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:19.622175    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" path="/var/lib/kubelet/pods/2f4cd45b-1cf9-455a-95fc-1cba7ca18d70/volumes"
Oct 30 21:45:19.622752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:19.622726    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" path="/var/lib/kubelet/pods/461ff178-e338-4cb9-801a-447e97afaf3f/volumes"
Oct 30 21:45:20.271130 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:20.271087    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:20.459304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:20.459261    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:20.917106 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:20.917043    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:21.077920 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:21.077871    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:45:25.714537 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:25.714495    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:30.492010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:30.491964    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:35.130589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:35.129140    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:40.006619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:40.004504    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:41.081569 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:41.081528    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"]
Oct 30 21:45:41.081981 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:41.081793    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" containerID="cri-o://45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05" gracePeriod=30
Oct 30 21:45:41.128356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:41.128330    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"]
Oct 30 21:45:41.128536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:41.128517    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy" containerID="cri-o://4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3" gracePeriod=30
Oct 30 21:45:44.647769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:44.647733    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:44.851933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:44.851894    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:45.043829 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:45.043741    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:45.948755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:45.948717    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:45.975533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:45.975505    4943 scope.go:122] "RemoveContainer" containerID="889571a2b770d00e0b0e003c720b6062d1a5e61ef78046c3ad35aff1d93ee95f"
Oct 30 21:45:46.185321 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.185282    4943 patch_prober.go:29] interesting pod/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Oct 30 21:45:46.185451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.185349    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Oct 30 21:45:46.448604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.441993    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:45:46.539424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.536677    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:45:46.569632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.569603    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-data\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.569844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.569831    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-data\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.569990 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.569972    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-credential-socket\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.570103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.570060    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-data" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.570172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.570131    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-data" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.570340 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.570320    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-credential-socket" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.570421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.570374    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-podinfo\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.570872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.570844    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f0935e2-78eb-4ed0-a007-84763f3fd807-istiod-ca-cert" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:46.570872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.570857    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0f0935e2-78eb-4ed0-a007-84763f3fd807-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0935e2-78eb-4ed0-a007-84763f3fd807-istiod-ca-cert\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.571032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.570911    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-certs\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.571032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571019    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-certs\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.571137 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571079    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-token\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-token\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.571137 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571125    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-token\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-token\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.571242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571198    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-certs" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.571242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571222    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-credential-socket\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.571343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571274    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-envoy\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.571343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571318    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istiod-ca-cert\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.571450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571384    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-podinfo\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.571450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571417    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-socket\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.571548 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.571459    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-kube-api-access-rhsxf\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-kube-api-access-rhsxf\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.572066 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.572040    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-certs" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.572249 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.572229    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-socket" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.572334 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.572252    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-envoy\") pod \"0f0935e2-78eb-4ed0-a007-84763f3fd807\" (UID: \"0f0935e2-78eb-4ed0-a007-84763f3fd807\") "
Oct 30 21:45:46.572334 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.572301    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-kube-api-access-sqncw\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-kube-api-access-sqncw\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.572334 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.572328    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-socket\") pod \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\" (UID: \"c2fe0b31-ad26-4889-9ced-242f8121a8ce\") "
Oct 30 21:45:46.572532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.572511    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istiod-ca-cert" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:46.572785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.572759    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-socket" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.573245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573221    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573253    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573268    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573281    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f0935e2-78eb-4ed0-a007-84763f3fd807-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573294    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573308    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573321    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573360    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.573685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.573376    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.576206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.576065    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-podinfo" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:45:46.576206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.576071    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-envoy" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.576373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.576265    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-credential-socket" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.576438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.576424    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-token" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:46.576970 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.576944    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-podinfo" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:45:46.577149 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.577119    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-envoy" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:46.577997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.577970    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-kube-api-access-sqncw" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "kube-api-access-sqncw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:46.579274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.579248    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-token" pod "c2fe0b31-ad26-4889-9ced-242f8121a8ce" (UID: "c2fe0b31-ad26-4889-9ced-242f8121a8ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:46.580175 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.580145    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-kube-api-access-rhsxf" pod "0f0935e2-78eb-4ed0-a007-84763f3fd807" (UID: "0f0935e2-78eb-4ed0-a007-84763f3fd807"). InnerVolumeSpecName "kube-api-access-rhsxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674847    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674888    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674905    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhsxf\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-kube-api-access-rhsxf\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674921    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674934    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqncw\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-kube-api-access-sqncw\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674948    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674961    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c2fe0b31-ad26-4889-9ced-242f8121a8ce-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674975    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f0935e2-78eb-4ed0-a007-84763f3fd807-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:46.676403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:46.674988    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f0935e2-78eb-4ed0-a007-84763f3fd807-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:47.016713 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.016680    4943 generic.go:356] "Generic (PLEG): container finished" podID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerID="45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05" exitCode=0
Oct 30 21:45:47.017186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.016769    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"
Oct 30 21:45:47.017186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.016767    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" event={"ID":"c2fe0b31-ad26-4889-9ced-242f8121a8ce","Type":"ContainerDied","Data":"45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05"}
Oct 30 21:45:47.017186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.016934    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp" event={"ID":"c2fe0b31-ad26-4889-9ced-242f8121a8ce","Type":"ContainerDied","Data":"37e9197c71047989d74b36a66ae08ab0721484b1f66f1a75b2e6a0f3d0da2513"}
Oct 30 21:45:47.017186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.016971    4943 scope.go:122] "RemoveContainer" containerID="45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05"
Oct 30 21:45:47.018937 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.018909    4943 generic.go:356] "Generic (PLEG): container finished" podID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerID="4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3" exitCode=0
Oct 30 21:45:47.019071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.018966    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"
Oct 30 21:45:47.019071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.018982    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" event={"ID":"0f0935e2-78eb-4ed0-a007-84763f3fd807","Type":"ContainerDied","Data":"4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3"}
Oct 30 21:45:47.019071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.019034    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977" event={"ID":"0f0935e2-78eb-4ed0-a007-84763f3fd807","Type":"ContainerDied","Data":"75e55ca1f80be3859c9b04699bbef4fea70774a3b9bb9b6d617545ecd2b07b9a"}
Oct 30 21:45:47.031592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.031569    4943 scope.go:122] "RemoveContainer" containerID="45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05"
Oct 30 21:45:47.031897 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:47.031875    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05\": container with ID starting with 45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05 not found: ID does not exist" containerID="45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05"
Oct 30 21:45:47.031970 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.031910    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05"} err="failed to get container status \"45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05\": rpc error: code = NotFound desc = could not find container \"45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05\": container with ID starting with 45cd8b831dc5b665fefaf9f5c9444c89d5ac20b80a87bfb839eda99ac3044b05 not found: ID does not exist"
Oct 30 21:45:47.031970 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.031933    4943 scope.go:122] "RemoveContainer" containerID="4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3"
Oct 30 21:45:47.042621 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.042603    4943 scope.go:122] "RemoveContainer" containerID="4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3"
Oct 30 21:45:47.042895 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:47.042875    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3\": container with ID starting with 4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3 not found: ID does not exist" containerID="4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3"
Oct 30 21:45:47.042961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.042902    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3"} err="failed to get container status \"4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3\": rpc error: code = NotFound desc = could not find container \"4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3\": container with ID starting with 4b8cbbb2de93a977fef17432b21d091ff2a61a700811d8a22662964dcc645fe3 not found: ID does not exist"
Oct 30 21:45:47.248211 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.248172    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"]
Oct 30 21:45:47.297667 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.297580    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-tl6gp"]
Oct 30 21:45:47.368634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.368504    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"]
Oct 30 21:45:47.375300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.375270    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-9796f1-openshift-default-5547cf6495-22977"]
Oct 30 21:45:47.628697 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.628605    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" path="/var/lib/kubelet/pods/0f0935e2-78eb-4ed0-a007-84763f3fd807/volumes"
Oct 30 21:45:47.629175 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:47.629156    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" path="/var/lib/kubelet/pods/c2fe0b31-ad26-4889-9ced-242f8121a8ce/volumes"
Oct 30 21:45:48.850519 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:48.850490    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"]
Oct 30 21:45:48.850947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:48.850715    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b" podUID="c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" containerName="maas-api" containerID="cri-o://0d1ee2d32c792ca44deb82e60b4987b2d615bb30518e230096f9bfeade94d8ba" gracePeriod=30
Oct 30 21:45:49.009978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.009939    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:49.115524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.113694    4943 generic.go:356] "Generic (PLEG): container finished" podID="c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" containerID="0d1ee2d32c792ca44deb82e60b4987b2d615bb30518e230096f9bfeade94d8ba" exitCode=0
Oct 30 21:45:49.115524 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.113751    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b" event={"ID":"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88","Type":"ContainerDied","Data":"0d1ee2d32c792ca44deb82e60b4987b2d615bb30518e230096f9bfeade94d8ba"}
Oct 30 21:45:49.325580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.318949    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:45:49.468581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.468514    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls\") pod \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") "
Oct 30 21:45:49.468752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.468625    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-metrics-certs\") pod \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") "
Oct 30 21:45:49.472613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.469506    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-openshift-service-ca\") pod \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") "
Oct 30 21:45:49.472613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.469549    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-kube-api-access-z8x9j\" (UniqueName: \"kubernetes.io/projected/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-kube-api-access-z8x9j\") pod \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\" (UID: \"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88\") "
Oct 30 21:45:49.472613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.470979    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-openshift-service-ca" pod "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" (UID: "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:49.472613 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.471676    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls" pod "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" (UID: "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:49.483481 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.483456    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-metrics-certs" pod "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" (UID: "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:45:49.484019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.484001    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-kube-api-access-z8x9j" pod "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" (UID: "c07f68d0-1b7c-4c23-ae3c-03ed67da3a88"). InnerVolumeSpecName "kube-api-access-z8x9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:49.572150 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.572032    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:49.572150 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.572070    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8x9j\" (UniqueName: \"kubernetes.io/projected/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-kube-api-access-z8x9j\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:49.572411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.572178    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:49.572411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:49.572302    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:50.125044 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.125010    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"
Oct 30 21:45:50.125546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.125028    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b" event={"ID":"c07f68d0-1b7c-4c23-ae3c-03ed67da3a88","Type":"ContainerDied","Data":"9f464a16238a42eccea15cb578d8c892367ee1f1d02fadb877a4b59f8994a371"}
Oct 30 21:45:50.125546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.125147    4943 scope.go:122] "RemoveContainer" containerID="0d1ee2d32c792ca44deb82e60b4987b2d615bb30518e230096f9bfeade94d8ba"
Oct 30 21:45:50.324486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.324454    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"]
Oct 30 21:45:50.328251 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.328229    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9173600a-79545757dd-mlg4b"]
Oct 30 21:45:50.555703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.555664    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:50.812180 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.812098    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:50.994800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:50.994740    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:51.065770 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:51.065676    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:45:51.620619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:51.620577    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" path="/var/lib/kubelet/pods/c07f68d0-1b7c-4c23-ae3c-03ed67da3a88/volumes"
Oct 30 21:45:53.702493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:53.702456    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"]
Oct 30 21:45:53.703049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:53.702676    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" containerID="cri-o://149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0" gracePeriod=30
Oct 30 21:45:53.752871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:53.752838    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"]
Oct 30 21:45:53.753102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:53.753065    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy" containerID="cri-o://8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80" gracePeriod=30
Oct 30 21:45:54.347511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:54.347460    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:55.047576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:55.045901    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:55.277310 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:55.277188    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:56.503511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.503474    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:56.894474 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.894365    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"]
Oct 30 21:45:56.894646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.894575    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" containerID="cri-o://4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d" gracePeriod=30
Oct 30 21:45:56.944049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.944021    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"]
Oct 30 21:45:56.944239 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.944218    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" containerID="cri-o://606cb9cff15ea093d1ea1da8517a87dc08b377c279fe61c8da9cfa22ea6a1124" gracePeriod=30
Oct 30 21:45:56.950206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.950177    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"]
Oct 30 21:45:56.950423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.950399    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy" containerID="cri-o://82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48" gracePeriod=30
Oct 30 21:45:56.994676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.994646    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"]
Oct 30 21:45:56.994851 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:56.994832    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy" containerID="cri-o://dbb85dbb2f9b300c7b75e693fa8a2b17f15d8b2ecf2e734d35142d23ee4cc1b3" gracePeriod=30
Oct 30 21:45:58.631006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:58.630970    4943 patch_prober.go:29] interesting pod/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:45:58.631465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:58.631042    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:45:59.059205 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.058463    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:45:59.088456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.088429    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:45:59.102136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102105    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-socket\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102182    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-credential-socket\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102240    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-token\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-token\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102311    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7beb9e2a-8867-413d-b6b4-0c138be630ba-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7beb9e2a-8867-413d-b6b4-0c138be630ba-istiod-ca-cert\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102402 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102368    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-data\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102378    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-socket" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.102465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102415    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-kube-api-access-vtd8j\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-kube-api-access-vtd8j\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102439    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-envoy\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102465 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102440    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-credential-socket" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.102679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102496    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-podinfo\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102615    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-certs\") pod \"7beb9e2a-8867-413d-b6b4-0c138be630ba\" (UID: \"7beb9e2a-8867-413d-b6b4-0c138be630ba\") "
Oct 30 21:45:59.102798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102701    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-data" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.102798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102770    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7beb9e2a-8867-413d-b6b4-0c138be630ba-istiod-ca-cert" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:59.102954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.102934    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-certs" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.103492 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.103465    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.103614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.103509    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.103614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.103525    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.103614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.103540    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7beb9e2a-8867-413d-b6b4-0c138be630ba-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.103614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.103568    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.104606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.104579    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-podinfo" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:45:59.104812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.104708    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-token" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:59.104872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.104827    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-envoy" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.104916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.104897    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-kube-api-access-vtd8j" pod "7beb9e2a-8867-413d-b6b4-0c138be630ba" (UID: "7beb9e2a-8867-413d-b6b4-0c138be630ba"). InnerVolumeSpecName "kube-api-access-vtd8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:59.110242 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.110221    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:59.204754 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.204673    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15376a9c-2cf0-402e-af11-158fa71738de-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15376a9c-2cf0-402e-af11-158fa71738de-istiod-ca-cert\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.204754 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.204730    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-socket\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.204975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.204765    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-data\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.204975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.204883    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-envoy\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.204975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.204938    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-credential-socket\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.205125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.204990    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/15376a9c-2cf0-402e-af11-158fa71738de-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15376a9c-2cf0-402e-af11-158fa71738de-istio-podinfo\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.205125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205017    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-socket" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.205125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205046    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15376a9c-2cf0-402e-af11-158fa71738de-istiod-ca-cert" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:45:59.205125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205055    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-data" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.205125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205093    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-certs\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.205371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205129    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-kube-api-access-bpj5f\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.205371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205174    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-credential-socket" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.205371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205220    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-istio-token\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-istio-token\") pod \"15376a9c-2cf0-402e-af11-158fa71738de\" (UID: \"15376a9c-2cf0-402e-af11-158fa71738de\") "
Oct 30 21:45:59.205371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205281    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-certs" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.205795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205773    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtd8j\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-kube-api-access-vtd8j\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205795    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205810    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15376a9c-2cf0-402e-af11-158fa71738de-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205822    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205836    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205849    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205864    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205878    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7beb9e2a-8867-413d-b6b4-0c138be630ba-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.205911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.205891    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.207375 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.207344    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15376a9c-2cf0-402e-af11-158fa71738de-istio-podinfo" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:45:59.207476 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.207372    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-envoy" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:45:59.207631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.207605    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-kube-api-access-bpj5f" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "kube-api-access-bpj5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:59.207747 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.207644    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-istio-token" pod "15376a9c-2cf0-402e-af11-158fa71738de" (UID: "15376a9c-2cf0-402e-af11-158fa71738de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:45:59.305284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.305242    4943 generic.go:356] "Generic (PLEG): container finished" podID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerID="149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0" exitCode=0
Oct 30 21:45:59.305451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.305294    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"
Oct 30 21:45:59.305451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.305327    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" event={"ID":"7beb9e2a-8867-413d-b6b4-0c138be630ba","Type":"ContainerDied","Data":"149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0"}
Oct 30 21:45:59.305451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.305389    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb" event={"ID":"7beb9e2a-8867-413d-b6b4-0c138be630ba","Type":"ContainerDied","Data":"d2dedd2fd764f20a99599dfa422172d6e4564788f30fe4b29e13cbb9140d9843"}
Oct 30 21:45:59.305451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.305412    4943 scope.go:122] "RemoveContainer" containerID="149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0"
Oct 30 21:45:59.306901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.306877    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15376a9c-2cf0-402e-af11-158fa71738de-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.307032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.306904    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15376a9c-2cf0-402e-af11-158fa71738de-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.307032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.306919    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpj5f\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-kube-api-access-bpj5f\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.307032 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.306934    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15376a9c-2cf0-402e-af11-158fa71738de-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:45:59.307274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.307070    4943 generic.go:356] "Generic (PLEG): container finished" podID="15376a9c-2cf0-402e-af11-158fa71738de" containerID="8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80" exitCode=0
Oct 30 21:45:59.307274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.307105    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" event={"ID":"15376a9c-2cf0-402e-af11-158fa71738de","Type":"ContainerDied","Data":"8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80"}
Oct 30 21:45:59.307274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.307137    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z" event={"ID":"15376a9c-2cf0-402e-af11-158fa71738de","Type":"ContainerDied","Data":"34932bda0969d557f4a9d645e227a5f6d7cb91fe7a012d883b6bc2def1ed765b"}
Oct 30 21:45:59.307274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.307145    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"
Oct 30 21:45:59.318511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.318493    4943 scope.go:122] "RemoveContainer" containerID="149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0"
Oct 30 21:45:59.318846 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:59.318827    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0\": container with ID starting with 149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0 not found: ID does not exist" containerID="149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0"
Oct 30 21:45:59.318911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.318855    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0"} err="failed to get container status \"149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0\": rpc error: code = NotFound desc = could not find container \"149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0\": container with ID starting with 149d4ec49ed18c63c76b6c01c37c8eec9d6a50f578122a649e4779a6c10563c0 not found: ID does not exist"
Oct 30 21:45:59.318911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.318872    4943 scope.go:122] "RemoveContainer" containerID="8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80"
Oct 30 21:45:59.324500 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.324477    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:45:59.331961 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.331934    4943 scope.go:122] "RemoveContainer" containerID="8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80"
Oct 30 21:45:59.332263 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:45:59.332244    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80\": container with ID starting with 8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80 not found: ID does not exist" containerID="8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80"
Oct 30 21:45:59.332318 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.332272    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80"} err="failed to get container status \"8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80\": rpc error: code = NotFound desc = could not find container \"8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80\": container with ID starting with 8cdbd10fdb6519dac17751239a0fb6a4a55cf58f4cf189fdcbe8030000ad9e80 not found: ID does not exist"
Oct 30 21:45:59.468188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.468080    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"]
Oct 30 21:45:59.479457 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.479422    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-7clrb"]
Oct 30 21:45:59.580890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.580854    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"]
Oct 30 21:45:59.589133 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.589105    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-8nh9z"]
Oct 30 21:45:59.619720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.619690    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15376a9c-2cf0-402e-af11-158fa71738de" path="/var/lib/kubelet/pods/15376a9c-2cf0-402e-af11-158fa71738de/volumes"
Oct 30 21:45:59.620185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:45:59.620170    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" path="/var/lib/kubelet/pods/7beb9e2a-8867-413d-b6b4-0c138be630ba/volumes"
Oct 30 21:46:00.284142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:00.284106    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:46:00.284532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:00.284176    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:46:01.808591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:01.808532    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:02.017735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.017702    4943 patch_prober.go:29] interesting pod/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 30 21:46:02.017883 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.017759    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 30 21:46:02.259693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.259662    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:46:02.346018 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.345949    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:46:02.359540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359510    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-socket\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.359709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359619    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-podinfo\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.359709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359658    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-certs\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.359872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359800    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-token\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-token\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.359872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359851    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-credential-socket\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.359980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359904    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-kube-api-access-ggwwp\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-kube-api-access-ggwwp\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.359980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359938    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-data\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.360094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.359992    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c94575f8-aa46-40d9-a852-1de7f7bd5277-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94575f8-aa46-40d9-a852-1de7f7bd5277-istiod-ca-cert\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.360094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.360059    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-envoy\") pod \"c94575f8-aa46-40d9-a852-1de7f7bd5277\" (UID: \"c94575f8-aa46-40d9-a852-1de7f7bd5277\") "
Oct 30 21:46:02.362061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.360617    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-certs" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.362061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.360700    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-socket" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.362061 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.360890    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-credential-socket" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.363201 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.363180    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.363599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.363583    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.363720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.363706    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.364538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.364315    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94575f8-aa46-40d9-a852-1de7f7bd5277-istiod-ca-cert" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:02.364538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.364424    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-data" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.375015 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.374384    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-token" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.375015 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.374728    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:02.376423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.376398    4943 generic.go:356] "Generic (PLEG): container finished" podID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerID="82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48" exitCode=0
Oct 30 21:46:02.377155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.376681    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"
Oct 30 21:46:02.377155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.376954    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" event={"ID":"f5252078-892f-404c-b5fe-9d4cbe3c118b","Type":"ContainerDied","Data":"82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48"}
Oct 30 21:46:02.377155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.377008    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn" event={"ID":"f5252078-892f-404c-b5fe-9d4cbe3c118b","Type":"ContainerDied","Data":"fdc18d4fcbbd30ca63cb8a0cba985a060e08ef78d65fcd7d2e41cbeeb447bd39"}
Oct 30 21:46:02.377155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.377045    4943 scope.go:122] "RemoveContainer" containerID="82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48"
Oct 30 21:46:02.380949 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.378920    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-podinfo" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:02.382873 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.382713    4943 generic.go:356] "Generic (PLEG): container finished" podID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerID="dbb85dbb2f9b300c7b75e693fa8a2b17f15d8b2ecf2e734d35142d23ee4cc1b3" exitCode=0
Oct 30 21:46:02.382873 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.382806    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" event={"ID":"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206","Type":"ContainerDied","Data":"dbb85dbb2f9b300c7b75e693fa8a2b17f15d8b2ecf2e734d35142d23ee4cc1b3"}
Oct 30 21:46:02.385415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.384965    4943 generic.go:356] "Generic (PLEG): container finished" podID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerID="4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d" exitCode=0
Oct 30 21:46:02.385415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.385065    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" event={"ID":"c94575f8-aa46-40d9-a852-1de7f7bd5277","Type":"ContainerDied","Data":"4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d"}
Oct 30 21:46:02.385415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.385110    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5" event={"ID":"c94575f8-aa46-40d9-a852-1de7f7bd5277","Type":"ContainerDied","Data":"3ba1e81ad3d296d441955e0443b7d6877b0c79763486df4a93628eb0289e0bee"}
Oct 30 21:46:02.385415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.385192    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"
Oct 30 21:46:02.387968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.387829    4943 generic.go:356] "Generic (PLEG): container finished" podID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerID="606cb9cff15ea093d1ea1da8517a87dc08b377c279fe61c8da9cfa22ea6a1124" exitCode=0
Oct 30 21:46:02.387968 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.387917    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" event={"ID":"eeced95a-8f11-4aba-8ab6-82a6288b836b","Type":"ContainerDied","Data":"606cb9cff15ea093d1ea1da8517a87dc08b377c279fe61c8da9cfa22ea6a1124"}
Oct 30 21:46:02.388988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.388952    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-envoy" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.401255 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.401211    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-kube-api-access-ggwwp" pod "c94575f8-aa46-40d9-a852-1de7f7bd5277" (UID: "c94575f8-aa46-40d9-a852-1de7f7bd5277"). InnerVolumeSpecName "kube-api-access-ggwwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.437978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.437834    4943 scope.go:122] "RemoveContainer" containerID="82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48"
Oct 30 21:46:02.438217 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:46:02.438191    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48\": container with ID starting with 82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48 not found: ID does not exist" containerID="82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48"
Oct 30 21:46:02.438316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.438236    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48"} err="failed to get container status \"82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48\": rpc error: code = NotFound desc = could not find container \"82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48\": container with ID starting with 82e4b0411c0faa0988eb1238ab5b0ade1724a3d83223241a72f0867dfa365c48 not found: ID does not exist"
Oct 30 21:46:02.438316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.438263    4943 scope.go:122] "RemoveContainer" containerID="4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d"
Oct 30 21:46:02.438879 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.438800    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:46:02.472849 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.472684    4943 scope.go:122] "RemoveContainer" containerID="4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d"
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.473281    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f5252078-892f-404c-b5fe-9d4cbe3c118b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5252078-892f-404c-b5fe-9d4cbe3c118b-istiod-ca-cert\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475121    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-podinfo\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475228    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-token\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-token\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475260    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-data\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475301    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-kube-api-access-s8sfb\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-kube-api-access-s8sfb\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475360    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-credential-socket\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475433    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-envoy\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475578    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-socket\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.475643    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-certs\") pod \"f5252078-892f-404c-b5fe-9d4cbe3c118b\" (UID: \"f5252078-892f-404c-b5fe-9d4cbe3c118b\") "
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:46:02.473470    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d\": container with ID starting with 4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d not found: ID does not exist" containerID="4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d"
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.476105    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d"} err="failed to get container status \"4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d\": rpc error: code = NotFound desc = could not find container \"4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d\": container with ID starting with 4b9e5fa07b6bca257acbef066f2d9765cc97695b7c3175dab48b76b6ce97911d not found: ID does not exist"
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.474943    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5252078-892f-404c-b5fe-9d4cbe3c118b-istiod-ca-cert" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.476586    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-credential-socket" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.476976    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-data" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.477658    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-socket" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.477706    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-certs" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.477790    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478380    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478403    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478417    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478431    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478446    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478460    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478474    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggwwp\" (UniqueName: \"kubernetes.io/projected/c94575f8-aa46-40d9-a852-1de7f7bd5277-kube-api-access-ggwwp\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478488    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478502    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5252078-892f-404c-b5fe-9d4cbe3c118b-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478516    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c94575f8-aa46-40d9-a852-1de7f7bd5277-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.478529    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c94575f8-aa46-40d9-a852-1de7f7bd5277-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.479493    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-kube-api-access-s8sfb" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "kube-api-access-s8sfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.485706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.481696    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-envoy" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.491728 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.491680    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-token" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.492266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.492236    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-podinfo" pod "f5252078-892f-404c-b5fe-9d4cbe3c118b" (UID: "f5252078-892f-404c-b5fe-9d4cbe3c118b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.594737    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-credential-socket\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.594786    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istiod-ca-cert\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.594875    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-certs\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.594926    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-data\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.594967    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eeced95a-8f11-4aba-8ab6-82a6288b836b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeced95a-8f11-4aba-8ab6-82a6288b836b-istiod-ca-cert\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.594997    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-kube-api-access-xvhvv\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-kube-api-access-xvhvv\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595025    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-envoy\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595111    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-certs\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595260    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-podinfo\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595299    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-envoy\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595335    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-token\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-token\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595367    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-kube-api-access-nxps8\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-kube-api-access-nxps8\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595425    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-credential-socket\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595456    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-socket\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595526    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-socket\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595582    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-data\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595640    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-podinfo\") pod \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\" (UID: \"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.595716    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-token\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-token\") pod \"eeced95a-8f11-4aba-8ab6-82a6288b836b\" (UID: \"eeced95a-8f11-4aba-8ab6-82a6288b836b\") "
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.596428    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.596451    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8sfb\" (UniqueName: \"kubernetes.io/projected/f5252078-892f-404c-b5fe-9d4cbe3c118b-kube-api-access-s8sfb\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.596467    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.596481    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5252078-892f-404c-b5fe-9d4cbe3c118b-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.603937    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-podinfo" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.604307    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeced95a-8f11-4aba-8ab6-82a6288b836b-istiod-ca-cert" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.606725    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-kube-api-access-xvhvv" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "kube-api-access-xvhvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.608895    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-envoy" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.609121    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-certs" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.609422    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istiod-ca-cert" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.609669    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-credential-socket" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.610819 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.609838    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-credential-socket" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.612774 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.612111    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-envoy" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.618640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.615032    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-data" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.618640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.615133    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-token" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.618640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.615252    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-data" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.618640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.617387    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-podinfo" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:02.618640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.617936    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-certs" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.618640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.617948    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-socket" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.618640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.618608    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-socket" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:02.619812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.619785    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-kube-api-access-nxps8" pod "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" (UID: "88aa4ed7-ac33-4a4c-ad3b-b51d281a6206"). InnerVolumeSpecName "kube-api-access-nxps8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.620894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.620869    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-token" pod "eeced95a-8f11-4aba-8ab6-82a6288b836b" (UID: "eeced95a-8f11-4aba-8ab6-82a6288b836b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:02.629172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.629146    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:02.698026 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.697997    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698030    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698052    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698068    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698082    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxps8\" (UniqueName: \"kubernetes.io/projected/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-kube-api-access-nxps8\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698098    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698112    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698128    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698143    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698158    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698172    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698186    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeced95a-8f11-4aba-8ab6-82a6288b836b-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698199    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698210    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698219    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698227    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeced95a-8f11-4aba-8ab6-82a6288b836b-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698237    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvhvv\" (UniqueName: \"kubernetes.io/projected/eeced95a-8f11-4aba-8ab6-82a6288b836b-kube-api-access-xvhvv\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.698351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.698245    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:02.878247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.878152    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"]
Oct 30 21:46:02.886958 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:02.886925    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-g8pp5"]
Oct 30 21:46:03.145358 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.145062    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"]
Oct 30 21:46:03.152579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.151189    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-hhxmn"]
Oct 30 21:46:03.398978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.398936    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"
Oct 30 21:46:03.400208 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.400181    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh" event={"ID":"88aa4ed7-ac33-4a4c-ad3b-b51d281a6206","Type":"ContainerDied","Data":"53cf623c8481624d56b477ce9a387ef13a4dde3fec232f3d59b93af16e7155b4"}
Oct 30 21:46:03.400326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.400234    4943 scope.go:122] "RemoveContainer" containerID="dbb85dbb2f9b300c7b75e693fa8a2b17f15d8b2ecf2e734d35142d23ee4cc1b3"
Oct 30 21:46:03.413597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.413537    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"
Oct 30 21:46:03.413755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.413569    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk" event={"ID":"eeced95a-8f11-4aba-8ab6-82a6288b836b","Type":"ContainerDied","Data":"3e2b23b9d1252c9edddd178b57124e0a19fcd3fa31d29d51acf2a26e776f567c"}
Oct 30 21:46:03.418216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.418196    4943 scope.go:122] "RemoveContainer" containerID="606cb9cff15ea093d1ea1da8517a87dc08b377c279fe61c8da9cfa22ea6a1124"
Oct 30 21:46:03.567274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.567239    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"]
Oct 30 21:46:03.572489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.572457    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-mmkxk"]
Oct 30 21:46:03.619946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.619918    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" path="/var/lib/kubelet/pods/c94575f8-aa46-40d9-a852-1de7f7bd5277/volumes"
Oct 30 21:46:03.620375 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.620362    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" path="/var/lib/kubelet/pods/eeced95a-8f11-4aba-8ab6-82a6288b836b/volumes"
Oct 30 21:46:03.620804 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.620790    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" path="/var/lib/kubelet/pods/f5252078-892f-404c-b5fe-9d4cbe3c118b/volumes"
Oct 30 21:46:03.679100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.679025    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"]
Oct 30 21:46:03.684639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:03.684616    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-446ca2-openshift-default-f46fcc757-f4qdh"]
Oct 30 21:46:04.599501 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:04.599466    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"]
Oct 30 21:46:04.599949 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:04.599750    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy" containerID="cri-o://fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b" gracePeriod=30
Oct 30 21:46:05.188412 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:05.188372    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:05.620442 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:05.620364    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" path="/var/lib/kubelet/pods/88aa4ed7-ac33-4a4c-ad3b-b51d281a6206/volumes"
Oct 30 21:46:05.656856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:05.656807    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:06.418767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:06.418730    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:08.134958 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:08.134917    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:08.370172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:08.370131    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:08.549398 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:08.549322    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:09.220678 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.220630    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:09.910702 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.910679    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:46:09.989611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989566    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-istio-token\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-istio-token\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.989803 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989628    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-credential-socket\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.989803 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989733    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-data\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.989803 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989792    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-certs\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.989965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989869    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4184a596-8abd-4833-8733-021d3d3a2106-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4184a596-8abd-4833-8733-021d3d3a2106-istio-podinfo\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.989965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989915    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-credential-socket" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:09.989965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989927    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-data" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:09.989965 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989919    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-socket\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.990198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.989974    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4184a596-8abd-4833-8733-021d3d3a2106-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4184a596-8abd-4833-8733-021d3d3a2106-istiod-ca-cert\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.990198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990030    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-certs" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:09.990198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990152    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-socket" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:09.990357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990240    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-envoy\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.990357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990286    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-kube-api-access-vcr7x\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-kube-api-access-vcr7x\") pod \"4184a596-8abd-4833-8733-021d3d3a2106\" (UID: \"4184a596-8abd-4833-8733-021d3d3a2106\") "
Oct 30 21:46:09.990459 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990378    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4184a596-8abd-4833-8733-021d3d3a2106-istiod-ca-cert" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:46:09.990866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990844    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.990993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990869    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4184a596-8abd-4833-8733-021d3d3a2106-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.990993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990884    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.990993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990899    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.990993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.990913    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:09.992309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.992240    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-istio-token" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:09.992466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.992445    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4184a596-8abd-4833-8733-021d3d3a2106-istio-podinfo" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:46:09.992706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.992685    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-kube-api-access-vcr7x" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "kube-api-access-vcr7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:46:09.992801 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:09.992707    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-envoy" pod "4184a596-8abd-4833-8733-021d3d3a2106" (UID: "4184a596-8abd-4833-8733-021d3d3a2106"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:46:10.092830 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.092799    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4184a596-8abd-4833-8733-021d3d3a2106-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.092830 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.092828    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcr7x\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-kube-api-access-vcr7x\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.092830 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.092840    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4184a596-8abd-4833-8733-021d3d3a2106-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.093100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.092849    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4184a596-8abd-4833-8733-021d3d3a2106-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:46:10.595614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.589386    4943 generic.go:356] "Generic (PLEG): container finished" podID="4184a596-8abd-4833-8733-021d3d3a2106" containerID="fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b" exitCode=0
Oct 30 21:46:10.595614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.589478    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" event={"ID":"4184a596-8abd-4833-8733-021d3d3a2106","Type":"ContainerDied","Data":"fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b"}
Oct 30 21:46:10.595614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.589532    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr" event={"ID":"4184a596-8abd-4833-8733-021d3d3a2106","Type":"ContainerDied","Data":"3406ffa3a941bc527299cb87319ff22b50771a85cc307ba3a036805ba37b4882"}
Oct 30 21:46:10.595614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.589584    4943 scope.go:122] "RemoveContainer" containerID="fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b"
Oct 30 21:46:10.595614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.589789    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"
Oct 30 21:46:10.613582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.613538    4943 scope.go:122] "RemoveContainer" containerID="fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b"
Oct 30 21:46:10.614045 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:46:10.614005    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b\": container with ID starting with fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b not found: ID does not exist" containerID="fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b"
Oct 30 21:46:10.614173 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.614057    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b"} err="failed to get container status \"fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b\": rpc error: code = NotFound desc = could not find container \"fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b\": container with ID starting with fc076370f50ed5ca9eb8f03a277a0e9a5f9a831dc8e0308a94c955067fe8108b not found: ID does not exist"
Oct 30 21:46:10.653592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.650512    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:10.827833 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.827792    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"]
Oct 30 21:46:10.833494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.833460    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-w68fr"]
Oct 30 21:46:10.858732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:10.858123    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:11.620049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:11.620015    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4184a596-8abd-4833-8733-021d3d3a2106" path="/var/lib/kubelet/pods/4184a596-8abd-4833-8733-021d3d3a2106/volumes"
Oct 30 21:46:13.891392 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:13.891342    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:14.083625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:14.083587    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:15.616475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:15.614792    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:16.188368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.188333    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"]
Oct 30 21:46:16.189732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189706    4943 cpu_manager.go:414] "containerMap: removing container" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy"
Oct 30 21:46:16.189732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189731    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189754    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189762    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189779    4943 cpu_manager.go:414] "containerMap: removing container" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189787    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189795    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189802    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189818    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189825    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189836    4943 cpu_manager.go:414] "containerMap: removing container" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189842    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189854    4943 cpu_manager.go:414] "containerMap: removing container" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189861    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189872    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189879    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189887    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.189892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189896    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189916    4943 cpu_manager.go:414] "containerMap: removing container" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189923    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189945    4943 cpu_manager.go:414] "containerMap: removing container" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189951    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189960    4943 cpu_manager.go:414] "containerMap: removing container" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189964    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189972    4943 cpu_manager.go:414] "containerMap: removing container" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189978    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189985    4943 cpu_manager.go:414] "containerMap: removing container" podUID="c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" containerName="maas-api"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189990    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" containerName="maas-api"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.189998    4943 cpu_manager.go:414] "containerMap: removing container" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190002    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190009    4943 cpu_manager.go:414] "containerMap: removing container" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190013    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190020    4943 cpu_manager.go:414] "containerMap: removing container" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190024    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190047    4943 cpu_manager.go:414] "containerMap: removing container" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190052    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190149    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190159    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190166    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2fe0b31-ad26-4889-9ced-242f8121a8ce" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190173    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190179    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="7beb9e2a-8867-413d-b6b4-0c138be630ba" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190186    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190192    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="15376a9c-2cf0-402e-af11-158fa71738de" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190198    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190204    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e0afe86-16a4-40c9-b817-e96af25f909d" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190211    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="88aa4ed7-ac33-4a4c-ad3b-b51d281a6206" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190217    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="4184a596-8abd-4833-8733-021d3d3a2106" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190223    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="c94575f8-aa46-40d9-a852-1de7f7bd5277" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190228    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="0f0935e2-78eb-4ed0-a007-84763f3fd807" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190233    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="c07f68d0-1b7c-4c23-ae3c-03ed67da3a88" containerName="maas-api"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190239    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190243    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="f5252078-892f-404c-b5fe-9d4cbe3c118b" containerName="istio-proxy"
Oct 30 21:46:16.190700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.190249    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="eeced95a-8f11-4aba-8ab6-82a6288b836b" containerName="istio-proxy"
Oct 30 21:46:16.195991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.195966    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.272937 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.272841    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"]
Oct 30 21:46:16.323194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.310894    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w1-3ddec2-openshift-default-dockercfg-bvfmv\""
Oct 30 21:46:16.324246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.324208    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-token\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.324682 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.324654    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istiod-ca-cert\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.324839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.324823    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-certs\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.324959 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.324940    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-data\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.325113 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.325097    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-podinfo\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.325225 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.325211    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-envoy\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.325357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.325343    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.325514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.325497    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz7z6\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-kube-api-access-gz7z6\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.326070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.326046    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-credential-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.357194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.357148    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435387    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz7z6\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-kube-api-access-gz7z6\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435448    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-credential-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435490    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-token\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435671    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istiod-ca-cert\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435712    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-certs\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435742    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-data\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435804    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-podinfo\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435837    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-envoy\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.435894    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.438827 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.436373    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.440397 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.440353    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-credential-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.441454 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.441429    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istiod-ca-cert\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.441899 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.441860    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-certs\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.442292 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.442270    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-data\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.478578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.477161    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-envoy\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.509756 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.509004    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz7z6\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-kube-api-access-gz7z6\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.515188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.514528    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-podinfo\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.518733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.518245    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-token\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.518733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.518507    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:16.616583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.612034    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:16.851658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:16.842111    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:17.098224 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.098190    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"]
Oct 30 21:46:17.098848 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:46:17.098816    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9659aeba_2abf_4b52_9453_9bfbe0fc07c8.slice/crio-64d1d194184552b94571a580ddec36de0ff87f26d2f4db4ec6a179240551143d WatchSource:0}: Error finding container 64d1d194184552b94571a580ddec36de0ff87f26d2f4db4ec6a179240551143d: Status 404 returned error can't find the container with id 64d1d194184552b94571a580ddec36de0ff87f26d2f4db4ec6a179240551143d
Oct 30 21:46:17.101878 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.101845    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:17.101986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.101927    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:17.101986 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.101971    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:17.698416 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.698372    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" event={"ID":"9659aeba-2abf-4b52-9453-9bfbe0fc07c8","Type":"ContainerStarted","Data":"94d32d6b742b284954af759fb947d0e477720d2de3efcca535eed22383c79b1e"}
Oct 30 21:46:17.698948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.698424    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" event={"ID":"9659aeba-2abf-4b52-9453-9bfbe0fc07c8","Type":"ContainerStarted","Data":"64d1d194184552b94571a580ddec36de0ff87f26d2f4db4ec6a179240551143d"}
Oct 30 21:46:17.781319 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.781283    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:17.821486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:17.821429    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podStartSLOduration=1.821413454 podStartE2EDuration="1.821413454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:17.817216044 +0000 UTC m=+1772.312789395" watchObservedRunningTime="2026-10-30 21:46:17.821413454 +0000 UTC m=+1772.316986806"
Oct 30 21:46:18.299129 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.299090    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"]
Oct 30 21:46:18.300030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.300008    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:18.300082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.300034    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:18.300220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.300186    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="461ff178-e338-4cb9-801a-447e97afaf3f" containerName="cleanup"
Oct 30 21:46:18.300220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.300220    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f4cd45b-1cf9-455a-95fc-1cba7ca18d70" containerName="cleanup"
Oct 30 21:46:18.304457 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.304436    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.365014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.364658    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fbb72e-openshift-default-dockercfg-rfsq5\""
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.398939    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-socket\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399045    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-envoy\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399158    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppp88\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-kube-api-access-ppp88\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399195    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-token\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399250    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-podinfo\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399280    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-certs\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399369    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istiod-ca-cert\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399511    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-data\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.399605    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-credential-socket\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.403538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.403452    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"]
Oct 30 21:46:18.443206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.443030    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:18.502952 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.502914    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-envoy\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.505848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.505808    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppp88\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-kube-api-access-ppp88\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.506105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.506085    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-token\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.506292 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.506258    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-podinfo\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.506432 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.506414    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-certs\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.506661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.506633    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istiod-ca-cert\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.506952 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.506932    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-data\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.507139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.507114    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-credential-socket\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.507368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.507349    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-socket\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.507484 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.507455    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-certs\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.508155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.508119    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-data\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.508695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.508673    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-socket\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.508812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.508786    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istiod-ca-cert\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.509118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.509100    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-envoy\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.509373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.509354    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-credential-socket\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.528672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.526865    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:18.544619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.543150    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-podinfo\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.596118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.589883    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:18.596118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.590653    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-token\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.596118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.591276    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppp88\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-kube-api-access-ppp88\") pod \"e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") " pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.630581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.620430    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:18.649398 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.649172    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:18.812761 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.812726    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:18.814963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:18.814920    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:46:19.287513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.287463    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"]
Oct 30 21:46:19.295050 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:46:19.295017    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce22d8b2_120f_4a21_ae8f_4b30f3ea5444.slice/crio-6931c58515994c7592b1a9de85e76697feedccc914462b986e0ebf288a48649c WatchSource:0}: Error finding container 6931c58515994c7592b1a9de85e76697feedccc914462b986e0ebf288a48649c: Status 404 returned error can't find the container with id 6931c58515994c7592b1a9de85e76697feedccc914462b986e0ebf288a48649c
Oct 30 21:46:19.298139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.298100    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:19.298254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.298194    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:19.298254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.298238    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:19.665846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.664617    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:19.822733 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.822693    4943 generic.go:356] "Generic (PLEG): container finished" podID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerID="9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7" exitCode=0
Oct 30 21:46:19.823190 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.822765    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" event={"ID":"8c715a6d-46b0-4817-b8b2-18352dd63802","Type":"ContainerDied","Data":"9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7"}
Oct 30 21:46:19.823312 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.823294    4943 scope.go:122] "RemoveContainer" containerID="9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7"
Oct 30 21:46:19.825689 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.825615    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" event={"ID":"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444","Type":"ContainerStarted","Data":"effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5"}
Oct 30 21:46:19.825689 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.825662    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" event={"ID":"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444","Type":"ContainerStarted","Data":"6931c58515994c7592b1a9de85e76697feedccc914462b986e0ebf288a48649c"}
Oct 30 21:46:19.833549 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.833508    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:19.833743 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.833629    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:19.833743 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:19.833679    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:46:20.066640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.066569    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podStartSLOduration=2.0665355930000002 podStartE2EDuration="2.066535593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:46:20.056664578 +0000 UTC m=+1774.552237930" watchObservedRunningTime="2026-10-30 21:46:20.066535593 +0000 UTC m=+1774.562108945"
Oct 30 21:46:20.621246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.621209    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:20.627546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.627524    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:20.725472 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.725432    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:20.835389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.835342    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" event={"ID":"8c715a6d-46b0-4817-b8b2-18352dd63802","Type":"ContainerStarted","Data":"745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42"}
Oct 30 21:46:20.835930 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.835836    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:20.836766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.836744    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:46:20.844065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.844042    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:46:20.845105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.845083    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:46:20.845206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:20.845147    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:46:21.065008 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:46:21.064970    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:46:21.853001 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:21.852963    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:46:21.853664 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:21.853619    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:46:22.065580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:22.065010    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:22.851580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:22.847651    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:46:22.851580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:22.847709    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:46:23.601208 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:23.601166    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:23.851963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:23.851885    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:46:23.852209 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:23.852179    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:46:23.896364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:23.896329    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:24.154606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:24.154541    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:46:24.172294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:24.172263    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:24.386579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:24.386519    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:24.852124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:24.852090    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:46:24.852790 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:24.852756    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:46:25.294983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:25.294938    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:25.856579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:25.852964    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:46:25.856579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:25.853028    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:46:26.851575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:26.847939    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Oct 30 21:46:26.851575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:26.848000    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Oct 30 21:46:27.139185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:27.139096    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:27.850097 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:27.850066    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:46:27.851432 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:27.851406    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:46:28.987051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:28.987016    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:29.226749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:29.226711    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:30.563576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:30.563185    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:31.857093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:31.857051    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:32.097578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:32.097016    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:34.510115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:34.510082    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:35.508332 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:35.508273    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:40.292829 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:40.292774    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:45.003408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:45.003367    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:45.944784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:45.944754    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:46:45.945526 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:45.945502    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:46:46.298878 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:46.298789    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:49.728913 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:49.728861    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:46:51.065635 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:46:51.065595    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:46:54.591295 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:46:54.591256    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:00.084895 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:00.084859    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:02.847658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:02.847620    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:03.200788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:03.200756    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:03.613230 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:03.613117    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:04.689203 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:04.689154    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:04.886291 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:04.886253    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:05.076904 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:05.076818    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:08.759433 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:08.759398    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:09.719178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:09.717439    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:09.950800 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:09.950757    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:14.542531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:14.542487    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:19.248692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:19.248647    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:21.063749 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:47:21.063707    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:47:24.014328 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:24.014290    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:25.375591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:25.375539    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:26.056843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:26.027471    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:26.275720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:26.275645    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:28.762695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:28.762620    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:28.944064 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:28.942923    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:29.120256 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:29.120164    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:30.858136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:30.858097    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:31.061072 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:31.061034    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:32.440249 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:32.440219    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:32.692215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:32.692122    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:33.876437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:33.876404    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:34.138429 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.138346    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"]
Oct 30 21:47:34.144704 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.144683    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.174017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.173984    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2tbg\" (UniqueName: \"kubernetes.io/projected/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-kube-api-access-q2tbg\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.174192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.174122    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-openshift-service-ca\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.174192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.174167    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.174312 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.174222    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-metrics-certs\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.205193 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.205172    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-fbb72e-serving-cert\""
Oct 30 21:47:34.216701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.216674    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:34.259645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.259617    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"]
Oct 30 21:47:34.275439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.275389    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2tbg\" (UniqueName: \"kubernetes.io/projected/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-kube-api-access-q2tbg\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.275633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.275599    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-openshift-service-ca\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.275853 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.275829    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.275981 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.275914    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-metrics-certs\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.276458 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:47:34.276425    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-serving-cert: secret "maas-api-e2e-api-a-fbb72e-serving-cert" not found
Oct 30 21:47:34.276587 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:47:34.276510    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls podName:be1d5ce2-ca46-4191-b1f3-9f81e8ed4603 nodeName:}" failed. No retries permitted until 2026-10-30 21:47:34.776491498 +0000 UTC m=+1849.272064841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls") pod "maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl" (UID: "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603") : secret "maas-api-e2e-api-a-fbb72e-serving-cert" not found
Oct 30 21:47:34.276587 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.276516    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-openshift-service-ca\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.279062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.279038    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-metrics-certs\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.368001 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.367969    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2tbg\" (UniqueName: \"kubernetes.io/projected/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-kube-api-access-q2tbg\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.546710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.546657    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:34.786504 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.785112    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.805634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.802812    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls\") pod \"maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:34.846578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:34.842154    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:35.063228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:35.063137    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:35.454342 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:35.454313    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"]
Oct 30 21:47:35.454781 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:47:35.454751    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1d5ce2_ca46_4191_b1f3_9f81e8ed4603.slice/crio-8b8a9f27c01e7ac48820070ed40b41bb81c129db2172903408d726452c84ef55 WatchSource:0}: Error finding container 8b8a9f27c01e7ac48820070ed40b41bb81c129db2172903408d726452c84ef55: Status 404 returned error can't find the container with id 8b8a9f27c01e7ac48820070ed40b41bb81c129db2172903408d726452c84ef55
Oct 30 21:47:35.536914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:35.536873    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl" event={"ID":"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603","Type":"ContainerStarted","Data":"8b8a9f27c01e7ac48820070ed40b41bb81c129db2172903408d726452c84ef55"}
Oct 30 21:47:36.549439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:36.549346    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl" event={"ID":"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603","Type":"ContainerStarted","Data":"290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce"}
Oct 30 21:47:36.549958 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:36.549442    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:36.693730 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:36.685782    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl" podStartSLOduration=1.868652708 podStartE2EDuration="2.685761664s" totalImagesPullingTime="817.108956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:36.666162974 +0000 UTC m=+1851.161736325" watchObservedRunningTime="2026-10-30 21:47:36.685761664 +0000 UTC m=+1851.181335025"
Oct 30 21:47:39.724417 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:39.724377    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:40.808011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.807968    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"]
Oct 30 21:47:40.812373 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.812348    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.864097 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.864066    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w4-218800-openshift-default-dockercfg-696vk\""
Oct 30 21:47:40.880345 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880314    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-podinfo\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.880473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880447    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x9ts\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-kube-api-access-4x9ts\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.880538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880495    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-data\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.880673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880630    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-envoy\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.880673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880657    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-token\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.880802 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880711    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-credential-socket\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.880908 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880876    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-socket\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.881046 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880919    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-certs\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.881046 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.880960    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istiod-ca-cert\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.922967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.922937    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"]
Oct 30 21:47:40.982282 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982245    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-socket\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982282 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982283    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-certs\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982312    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istiod-ca-cert\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982400    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-podinfo\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982460    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x9ts\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-kube-api-access-4x9ts\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982496    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-data\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982794 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982551    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-envoy\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982794 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982596    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-token\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982794 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982673    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-credential-socket\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.982794 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982696    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-socket\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.983023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.982986    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-data\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.983105 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.983083    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-credential-socket\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.983175 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.983153    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-certs\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.983259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.983240    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istiod-ca-cert\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.985104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.985070    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-envoy\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:40.985312 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:40.985292    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-podinfo\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:41.039638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.039608    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-token\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:41.039892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.039872    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x9ts\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-kube-api-access-4x9ts\") pod \"e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") " pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:41.125689 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.125610    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:41.561008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.560979    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"]
Oct 30 21:47:41.562127 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:47:41.562094    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d1f2866_4f70_47c9_bdde_089dfcdf1521.slice/crio-4d66c9af990c71a7fe8232d38f30cfb9e911a5d15ede588ed280f06794cf59d2 WatchSource:0}: Error finding container 4d66c9af990c71a7fe8232d38f30cfb9e911a5d15ede588ed280f06794cf59d2: Status 404 returned error can't find the container with id 4d66c9af990c71a7fe8232d38f30cfb9e911a5d15ede588ed280f06794cf59d2
Oct 30 21:47:41.564931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.564893    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:47:41.565023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.564965    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:47:41.565023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.564996    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:47:41.598608 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:41.598576    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" event={"ID":"0d1f2866-4f70-47c9-bdde-089dfcdf1521","Type":"ContainerStarted","Data":"4d66c9af990c71a7fe8232d38f30cfb9e911a5d15ede588ed280f06794cf59d2"}
Oct 30 21:47:42.575653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:42.575623    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:47:42.607241 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:42.607209    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" event={"ID":"0d1f2866-4f70-47c9-bdde-089dfcdf1521","Type":"ContainerStarted","Data":"416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920"}
Oct 30 21:47:42.821921 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:42.821867    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" podStartSLOduration=2.821851601 podStartE2EDuration="2.821851601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:47:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:47:42.816399263 +0000 UTC m=+1857.311972619" watchObservedRunningTime="2026-10-30 21:47:42.821851601 +0000 UTC m=+1857.317425017"
Oct 30 21:47:43.126601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:43.126566    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:43.128120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:43.128089    4943 patch_prober.go:29] interesting pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:47:43.128258 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:43.128138    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:47:44.126434 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:44.126400    4943 patch_prober.go:29] interesting pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:47:44.126869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:44.126452    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:47:44.616683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:44.616646    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:45.126305 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:45.126264    4943 patch_prober.go:29] interesting pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:47:45.126479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:45.126344    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:47:46.126769 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:46.126735    4943 patch_prober.go:29] interesting pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:47:46.127141 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:46.126788    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:47:46.667407 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:46.667370    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:47.126987 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:47.126908    4943 patch_prober.go:29] interesting pod/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused" start-of-body=
Oct 30 21:47:47.126987 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:47.126960    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.110:15021/healthz/ready\": dial tcp 10.132.0.110:15021: connect: connection refused"
Oct 30 21:47:48.131288 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:48.131249    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:48.131744 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:48.131573    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:48.132330 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:48.132312    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:47:49.422575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:49.421532    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:51.064482 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:47:51.064437    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:47:51.554771 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:51.554727    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:54.134404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:54.130309    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:57.706596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:57.706535    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:47:59.360580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:47:59.357821    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:00.165578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:00.164634    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:00.193578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:00.191832    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:00.220576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:00.216634    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:00.276579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:00.269625    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:00.349581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:00.349122    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:00.452638 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:00.449691    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:00.493578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:00.492681    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.115576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.115371    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.164586 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.154835    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.181030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.177658    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" probeResult="failure" output="Get \"https://10.132.0.75:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.181030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.178178    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:48:01.260583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.251666    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.260583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.252078    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:48:01.276700 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.276663    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.277310 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.277288    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:48:01.354498 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.352674    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.354498 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.353113    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:48:01.362684 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.362634    4943 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:01.469579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.469344    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": context deadline exceeded"
Oct 30 21:48:01.470080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.469784    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:48:01.553594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.523727    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.64:8000/ready\": context deadline exceeded"
Oct 30 21:48:01.553594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.524844    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:48:01.976612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.966539    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:48:01.976612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:01.966661    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:48:02.022601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.013370    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 21:48:02.027858 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.027834    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:48:02.198610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.167722    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:02.198610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.168360    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:48:02.218575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.212204    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:48:02.385636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.372047    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:48:02.385636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.372146    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.65:8000/ready\": context deadline exceeded"
Oct 30 21:48:02.526457 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:02.526428    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:48:05.228720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:05.228599    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:06.877759 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:06.877717    4943 patch_prober.go:29] interesting pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 21:48:06.878254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:06.877786    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:48:09.827764 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:09.827698    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:10.084114 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:10.084012    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:10.353645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:10.352197    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:13.186673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:13.186625    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"]
Oct 30 21:48:13.187423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:13.187388    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" containerID="cri-o://13abe1c9c43a4ee145e08e1fdbd03de4986671c0d1da69d8d30c01406e6ab4a8" gracePeriod=30
Oct 30 21:48:13.235371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:13.235336    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"]
Oct 30 21:48:13.459618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:13.459502    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" containerID="cri-o://9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d" gracePeriod=30
Oct 30 21:48:14.469263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:14.469229    4943 generic.go:356] "Generic (PLEG): container finished" podID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerID="effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5" exitCode=0
Oct 30 21:48:14.469766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:14.469303    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" event={"ID":"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444","Type":"ContainerDied","Data":"effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5"}
Oct 30 21:48:14.469919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:14.469891    4943 scope.go:122] "RemoveContainer" containerID="effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5"
Oct 30 21:48:14.471787 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:14.471761    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:48:14.471893 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:14.471836    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:48:14.471893 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:14.471871    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:48:15.154521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:15.137829    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:15.485698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:15.485601    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" event={"ID":"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444","Type":"ContainerStarted","Data":"c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745"}
Oct 30 21:48:15.621828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:15.621791    4943 patch_prober.go:29] interesting pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:48:15.622130 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:15.622089    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:48:15.623809 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:15.623784    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:48:16.621663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:16.621589    4943 patch_prober.go:29] interesting pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:48:16.621663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:16.621644    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:48:16.926179 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:16.926148    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:48:16.926342 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:16.926213    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:48:17.507332 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.507300    4943 generic.go:356] "Generic (PLEG): container finished" podID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerID="94d32d6b742b284954af759fb947d0e477720d2de3efcca535eed22383c79b1e" exitCode=0
Oct 30 21:48:17.507506 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.507390    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" event={"ID":"9659aeba-2abf-4b52-9453-9bfbe0fc07c8","Type":"ContainerDied","Data":"94d32d6b742b284954af759fb947d0e477720d2de3efcca535eed22383c79b1e"}
Oct 30 21:48:17.508016 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.507975    4943 scope.go:122] "RemoveContainer" containerID="94d32d6b742b284954af759fb947d0e477720d2de3efcca535eed22383c79b1e"
Oct 30 21:48:17.509828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.509799    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:48:17.509958 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.509878    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:48:17.509958 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.509930    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:48:17.622701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.622665    4943 patch_prober.go:29] interesting pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:48:17.623274 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.622757    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:48:17.691869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.691741    4943 patch_prober.go:29] interesting pod/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:48:17.691869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:17.691806    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:48:18.526253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.525620    4943 generic.go:356] "Generic (PLEG): container finished" podID="6885f882-ff36-4663-ae23-15ce669a5a04" containerID="13abe1c9c43a4ee145e08e1fdbd03de4986671c0d1da69d8d30c01406e6ab4a8" exitCode=0
Oct 30 21:48:18.526253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.525840    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" event={"ID":"6885f882-ff36-4663-ae23-15ce669a5a04","Type":"ContainerDied","Data":"13abe1c9c43a4ee145e08e1fdbd03de4986671c0d1da69d8d30c01406e6ab4a8"}
Oct 30 21:48:18.529325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.529280    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" event={"ID":"9659aeba-2abf-4b52-9453-9bfbe0fc07c8","Type":"ContainerStarted","Data":"9b605fea919a4488c257c6388aef7eaaeee1ae6403904a819ec628fbaca4c650"}
Oct 30 21:48:18.630523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.630046    4943 patch_prober.go:29] interesting pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:48:18.630523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.630127    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:48:18.718635 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.718313    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:48:18.815645 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.814847    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:48:18.819027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.818989    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-kube-api-access-2m9gl\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-kube-api-access-2m9gl\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.819174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819079    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6885f882-ff36-4663-ae23-15ce669a5a04-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6885f882-ff36-4663-ae23-15ce669a5a04-istio-podinfo\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.819174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819168    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-istio-token\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-istio-token\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.819305 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819224    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-envoy\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.819364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819319    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-data\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.819422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819384    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-socket\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.819478 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819462    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-certs\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.820101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819604    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6885f882-ff36-4663-ae23-15ce669a5a04-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6885f882-ff36-4663-ae23-15ce669a5a04-istiod-ca-cert\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.820101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819648    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-credential-socket\") pod \"6885f882-ff36-4663-ae23-15ce669a5a04\" (UID: \"6885f882-ff36-4663-ae23-15ce669a5a04\") "
Oct 30 21:48:18.820101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.819904    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-socket" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:18.820101 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.820039    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-certs" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:18.820363 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.820229    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-data" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:18.820427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.820393    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.820427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.820411    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.820427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.820425    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.820677 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.820652    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-credential-socket" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:18.820762 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.820676    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6885f882-ff36-4663-ae23-15ce669a5a04-istiod-ca-cert" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:18.822988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.822961    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-kube-api-access-2m9gl" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "kube-api-access-2m9gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:18.830702 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.830668    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-istio-token" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:18.835514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.835468    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-envoy" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:18.835668 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.835582    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6885f882-ff36-4663-ae23-15ce669a5a04-istio-podinfo" pod "6885f882-ff36-4663-ae23-15ce669a5a04" (UID: "6885f882-ff36-4663-ae23-15ce669a5a04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:48:18.922596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.922460    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m9gl\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-kube-api-access-2m9gl\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.922596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.922494    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6885f882-ff36-4663-ae23-15ce669a5a04-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.922596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.922504    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6885f882-ff36-4663-ae23-15ce669a5a04-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.922596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.922513    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.922596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.922522    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6885f882-ff36-4663-ae23-15ce669a5a04-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:18.922596 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:18.922531    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6885f882-ff36-4663-ae23-15ce669a5a04-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.037225 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.036871    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:48:19.125145 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125054    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/298adac8-df56-4426-a291-6a3b1d957cda-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/298adac8-df56-4426-a291-6a3b1d957cda-istio-podinfo\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125145 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125101    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-credential-socket\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125145 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125135    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-istio-token\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-istio-token\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125242    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-kube-api-access-bmllr\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-kube-api-access-bmllr\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125289    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-socket\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125342    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-certs\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125474 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125378    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/298adac8-df56-4426-a291-6a3b1d957cda-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/298adac8-df56-4426-a291-6a3b1d957cda-istiod-ca-cert\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125474 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125436    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-data\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.125538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.125492    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-envoy\") pod \"298adac8-df56-4426-a291-6a3b1d957cda\" (UID: \"298adac8-df56-4426-a291-6a3b1d957cda\") "
Oct 30 21:48:19.126132 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.126102    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-certs" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:19.126322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.126111    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-data" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:19.126436 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.126126    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-credential-socket" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:19.126539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.126199    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/298adac8-df56-4426-a291-6a3b1d957cda-istiod-ca-cert" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:48:19.126697 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.126359    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-socket" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:19.128014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.127989    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-kube-api-access-bmllr" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "kube-api-access-bmllr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:19.128451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.128427    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-istio-token" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:48:19.128688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.128669    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/298adac8-df56-4426-a291-6a3b1d957cda-istio-podinfo" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:48:19.128743 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.128704    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-envoy" pod "298adac8-df56-4426-a291-6a3b1d957cda" (UID: "298adac8-df56-4426-a291-6a3b1d957cda"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:48:19.227842 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.227811    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228023    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/298adac8-df56-4426-a291-6a3b1d957cda-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228048    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228065    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228078    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/298adac8-df56-4426-a291-6a3b1d957cda-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228092    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228106    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228120    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmllr\" (UniqueName: \"kubernetes.io/projected/298adac8-df56-4426-a291-6a3b1d957cda-kube-api-access-bmllr\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.228156 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.228137    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/298adac8-df56-4426-a291-6a3b1d957cda-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:48:19.521962 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.521923    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:48:19.522707 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.522682    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:48:19.522846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.522741    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:48:19.576589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.570208    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr" event={"ID":"6885f882-ff36-4663-ae23-15ce669a5a04","Type":"ContainerDied","Data":"8eb9aacd46b8404c48f80e6fd2cdf4d2d04038599a2e5ebd35738c702b0aa451"}
Oct 30 21:48:19.577314 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.577288    4943 scope.go:122] "RemoveContainer" containerID="13abe1c9c43a4ee145e08e1fdbd03de4986671c0d1da69d8d30c01406e6ab4a8"
Oct 30 21:48:19.577590 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.570719    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"
Oct 30 21:48:19.605253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.605212    4943 generic.go:356] "Generic (PLEG): container finished" podID="298adac8-df56-4426-a291-6a3b1d957cda" containerID="9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d" exitCode=0
Oct 30 21:48:19.607382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.607343    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" event={"ID":"298adac8-df56-4426-a291-6a3b1d957cda","Type":"ContainerDied","Data":"9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d"}
Oct 30 21:48:19.607647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.607617    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr" event={"ID":"298adac8-df56-4426-a291-6a3b1d957cda","Type":"ContainerDied","Data":"f732a6554b3efd315ca5bc25f2a2463b96aebf00b1f3da996be6a8abf8637663"}
Oct 30 21:48:19.607805 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.607540    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"
Oct 30 21:48:19.621102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.621077    4943 patch_prober.go:29] interesting pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:48:19.621164 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.621134    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:48:19.623254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.623125    4943 scope.go:122] "RemoveContainer" containerID="9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d"
Oct 30 21:48:19.635075 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.634878    4943 scope.go:122] "RemoveContainer" containerID="9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d"
Oct 30 21:48:19.635309 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:48:19.635175    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d\": container with ID starting with 9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d not found: ID does not exist" containerID="9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d"
Oct 30 21:48:19.635309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.635201    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d"} err="failed to get container status \"9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d\": rpc error: code = NotFound desc = could not find container \"9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d\": container with ID starting with 9747cf66cc769145c70fb85ba12fc12a18258c8ea606487584744cdafe94745d not found: ID does not exist"
Oct 30 21:48:19.796636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.795751    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"]
Oct 30 21:48:19.809690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.808816    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-v8jjr"]
Oct 30 21:48:19.904944 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.904582    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"]
Oct 30 21:48:19.910483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:19.910452    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-6rwhr"]
Oct 30 21:48:20.054632 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:20.052594    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:20.522644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:20.522609    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:48:20.522978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:20.522686    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:48:20.621277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:20.621239    4943 patch_prober.go:29] interesting pod/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 30 21:48:20.621456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:20.621305    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 30 21:48:20.836092 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:20.835996    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:48:21.094246 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:48:21.094162    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:48:21.522395 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:21.522360    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:48:21.522603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:21.522411    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:48:21.619871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:21.619828    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="298adac8-df56-4426-a291-6a3b1d957cda" path="/var/lib/kubelet/pods/298adac8-df56-4426-a291-6a3b1d957cda/volumes"
Oct 30 21:48:21.620387 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:21.620367    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" path="/var/lib/kubelet/pods/6885f882-ff36-4663-ae23-15ce669a5a04/volumes"
Oct 30 21:48:21.626013 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:21.625991    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:48:21.627086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:21.627066    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:48:22.522181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:22.522142    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:48:22.522594 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:22.522200    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:48:23.522536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:23.522493    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 30 21:48:23.522973 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:23.522612    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 30 21:48:24.527425 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:24.527382    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:48:24.528443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:24.528421    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:48:25.183058 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:25.183025    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:26.899818 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:26.899773    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:27.443569 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:27.443521    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:28.170013 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:28.168614    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:28.389226 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:28.389189    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:29.830604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:29.830310    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:31.783441 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:31.783407    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:32.070214 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:32.070116    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:32.347008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:32.346816    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:32.733955 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:32.733906    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:33.661308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:33.661267    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:34.300152 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:34.300101    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:34.932775 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:34.932739    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:37.698335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:37.698289    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:38.527999 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:38.527948    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:38.729115 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:38.729075    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:39.053378 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:39.053310    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:39.254624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:39.254592    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:39.862975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:39.862935    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:40.963847 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:40.963812    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:41.274905 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:41.274825    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:41.473307 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:41.473272    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:41.748427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:41.748389    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:42.393140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.392974    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:42.868502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.868467    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"]
Oct 30 21:48:42.869199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.869181    4943 cpu_manager.go:414] "containerMap: removing container" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy"
Oct 30 21:48:42.869246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.869203    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy"
Oct 30 21:48:42.869246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.869231    4943 cpu_manager.go:414] "containerMap: removing container" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy"
Oct 30 21:48:42.869246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.869237    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy"
Oct 30 21:48:42.869367 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.869356    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="298adac8-df56-4426-a291-6a3b1d957cda" containerName="istio-proxy"
Oct 30 21:48:42.869400 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.869372    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="6885f882-ff36-4663-ae23-15ce669a5a04" containerName="istio-proxy"
Oct 30 21:48:42.871736 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.871718    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.889102 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.889074    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.889252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.889229    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-metrics-certs\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.889324 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.889272    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ff8730-c6df-48ef-8d3e-1378b522a7dd-openshift-service-ca\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.889444 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.889423    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt86r\" (UniqueName: \"kubernetes.io/projected/79ff8730-c6df-48ef-8d3e-1378b522a7dd-kube-api-access-rt86r\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.936916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.936893    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b34958-serving-cert\""
Oct 30 21:48:42.995030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.994986    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-metrics-certs\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.997786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.996080    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ff8730-c6df-48ef-8d3e-1378b522a7dd-openshift-service-ca\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.998360 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.998309    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt86r\" (UniqueName: \"kubernetes.io/projected/79ff8730-c6df-48ef-8d3e-1378b522a7dd-kube-api-access-rt86r\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.998679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.998657    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:42.999033 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:48:42.998995    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-serving-cert: secret "maas-api-e2e-api-a-b34958-serving-cert" not found
Oct 30 21:48:43.001292 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:48:43.001278    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls podName:79ff8730-c6df-48ef-8d3e-1378b522a7dd nodeName:}" failed. No retries permitted until 2026-10-30 21:48:43.5012547 +0000 UTC m=+1917.996828029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls") pod "maas-api-e2e-api-a-b34958-775868bcb4-h6t6z" (UID: "79ff8730-c6df-48ef-8d3e-1378b522a7dd") : secret "maas-api-e2e-api-a-b34958-serving-cert" not found
Oct 30 21:48:43.001648 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:42.996888    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ff8730-c6df-48ef-8d3e-1378b522a7dd-openshift-service-ca\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:43.036106 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.028368    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"]
Oct 30 21:48:43.061604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.061379    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt86r\" (UniqueName: \"kubernetes.io/projected/79ff8730-c6df-48ef-8d3e-1378b522a7dd-kube-api-access-rt86r\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:43.064000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.063407    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-metrics-certs\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:43.113573 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.113485    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:43.351379 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.351342    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:43.508509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.508473    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:43.511131 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.511100    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls\") pod \"maas-api-e2e-api-a-b34958-775868bcb4-h6t6z\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:43.784360 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:43.784328    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:44.164920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:44.164884    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"]
Oct 30 21:48:44.171061 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:48:44.171032    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ff8730_c6df_48ef_8d3e_1378b522a7dd.slice/crio-d9529241d07fa29d3d5811e54598c6be2a18bb7a634da0e46815f351c8a8f5ab WatchSource:0}: Error finding container d9529241d07fa29d3d5811e54598c6be2a18bb7a634da0e46815f351c8a8f5ab: Status 404 returned error can't find the container with id d9529241d07fa29d3d5811e54598c6be2a18bb7a634da0e46815f351c8a8f5ab
Oct 30 21:48:44.949991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:44.949957    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z" event={"ID":"79ff8730-c6df-48ef-8d3e-1378b522a7dd","Type":"ContainerStarted","Data":"d9529241d07fa29d3d5811e54598c6be2a18bb7a634da0e46815f351c8a8f5ab"}
Oct 30 21:48:45.957854 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:45.957821    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z" event={"ID":"79ff8730-c6df-48ef-8d3e-1378b522a7dd","Type":"ContainerStarted","Data":"158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61"}
Oct 30 21:48:45.958257 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:45.957901    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:46.499151 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:46.499122    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:46.701542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:46.701501    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:47.018348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:47.018307    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:48.555892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:48.555852    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:49.068905 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:49.068861    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:49.265577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:49.262948    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:51.065454 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:48:51.065419    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:48:51.970146 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:51.970118    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:48:52.088128 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:52.088076    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z" podStartSLOduration=9.308138892 podStartE2EDuration="10.088060862s" totalImagesPullingTime="779.92197ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:48:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:48:46.082371162 +0000 UTC m=+1920.577944514" watchObservedRunningTime="2026-10-30 21:48:52.088060862 +0000 UTC m=+1926.583634380"
Oct 30 21:48:53.818326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:53.818284    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:53.991380 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:53.991347    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:59.306713 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:59.306482    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:48:59.498916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:48:59.498887    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:00.888245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:00.888208    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:01.210654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:01.210622    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:01.620136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:01.620052    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:01.796202 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:01.795787    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:01.985050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:01.985017    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:02.849633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.849588    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"]
Oct 30 21:49:02.854681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.854650    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.955489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.955422    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-istio-token\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.955698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.955609    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-certs\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.955698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.955687    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-data\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.955828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.955740    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-envoy\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.955828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.955806    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf23461-e811-4fd6-8b06-6dae67380128-istio-podinfo\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.955940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.955877    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-credential-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.956018 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.956000    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.956155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.956118    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bgtr\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-kube-api-access-6bgtr\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:02.956593 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:02.956572    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf23461-e811-4fd6-8b06-6dae67380128-istiod-ca-cert\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.056714 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.052451    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:03.060974 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.060937    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.061308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.061282    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bgtr\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-kube-api-access-6bgtr\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.064212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.061478    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf23461-e811-4fd6-8b06-6dae67380128-istiod-ca-cert\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.064453 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.064432    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-istio-token\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.071246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.064590    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-certs\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.071467 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.071447    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-data\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.071640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.071622    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-envoy\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.071798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.071784    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf23461-e811-4fd6-8b06-6dae67380128-istio-podinfo\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.072010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.071940    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-credential-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.073444 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.072685    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-credential-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.073636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.073114    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-socket\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.073744 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.073663    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-certs\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.073839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.073762    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-data\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.074322 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.074276    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf23461-e811-4fd6-8b06-6dae67380128-istiod-ca-cert\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.109671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.079808    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-envoy\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.109671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.101221    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf23461-e811-4fd6-8b06-6dae67380128-istio-podinfo\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.111065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.111005    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"]
Oct 30 21:49:03.130941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.130913    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bgtr\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-kube-api-access-6bgtr\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.136541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.136507    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-istio-token\") pod \"e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") " pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.171740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.171714    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:03.580057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.579229    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:03.624013 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.623977    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"]
Oct 30 21:49:03.632971 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:49:03.632920    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cf23461_e811_4fd6_8b06_6dae67380128.slice/crio-64a5e35250cb8ed9b4d17f7fb9a6f6c3f8cce71b059886242aa6e4cf57fbc517 WatchSource:0}: Error finding container 64a5e35250cb8ed9b4d17f7fb9a6f6c3f8cce71b059886242aa6e4cf57fbc517: Status 404 returned error can't find the container with id 64a5e35250cb8ed9b4d17f7fb9a6f6c3f8cce71b059886242aa6e4cf57fbc517
Oct 30 21:49:03.636272 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.636233    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:49:03.636371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.636329    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:49:03.636417 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:03.636373    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:49:04.133960 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:04.133920    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" event={"ID":"7cf23461-e811-4fd6-8b06-6dae67380128","Type":"ContainerStarted","Data":"6261f904939d975bcb124d5d73324eb205eb45b2cb6f9c96a42400a1db74a8bb"}
Oct 30 21:49:04.134378 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:04.133990    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" event={"ID":"7cf23461-e811-4fd6-8b06-6dae67380128","Type":"ContainerStarted","Data":"64a5e35250cb8ed9b4d17f7fb9a6f6c3f8cce71b059886242aa6e4cf57fbc517"}
Oct 30 21:49:04.172591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:04.172510    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:04.174018 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:04.173984    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:49:04.174178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:04.174059    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:49:04.252997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:04.252934    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podStartSLOduration=2.2529210490000002 podStartE2EDuration="2.252921049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:04.250067891 +0000 UTC m=+1938.745641245" watchObservedRunningTime="2026-10-30 21:49:04.252921049 +0000 UTC m=+1938.748494400"
Oct 30 21:49:04.580210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:04.580168    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:05.176579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:05.174984    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:49:05.176579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:05.175048    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:49:05.554634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:05.548081    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:05.734780 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:05.734740    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:05.910646 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:05.910605    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:06.176634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:06.175592    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:49:06.176634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:06.175660    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:49:07.172191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:07.172154    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:49:07.172368 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:07.172210    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:49:08.192707 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:08.192223    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:49:08.192707 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:08.192285    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:49:08.274264 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:08.274229    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:08.498298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:08.498218    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:08.775656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:08.775247    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:09.020753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:09.020702    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:09.174067 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:09.174020    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:49:09.174410 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:09.174376    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:49:09.225325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:09.225142    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:10.174962 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:10.174915    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused" start-of-body=
Oct 30 21:49:10.175172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:10.175018    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.112:15021/healthz/ready\": dial tcp 10.132.0.112:15021: connect: connection refused"
Oct 30 21:49:10.598644 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:10.595605    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:11.177495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:11.177465    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:11.177975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:11.177956    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:11.178830 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:11.178808    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:49:13.744717 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:13.744683    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:13.934892 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:13.934855    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:15.429681 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:15.429600    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:20.207036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:20.206992    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:21.070115 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:49:21.070075    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:49:21.106139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:21.106098    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"]
Oct 30 21:49:21.106382 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:21.106359    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy" containerID="cri-o://6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d" gracePeriod=30
Oct 30 21:49:21.156155 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:21.156120    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"]
Oct 30 21:49:21.156406 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:21.156373    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy" containerID="cri-o://22bf9e6a7b372eb396d420b767a9a1758f38007d4278fa253c40c253439c3de9" gracePeriod=30
Oct 30 21:49:24.944658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:24.944613    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:26.436096 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.436066    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:49:26.447637 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.447608    4943 generic.go:356] "Generic (PLEG): container finished" podID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerID="22bf9e6a7b372eb396d420b767a9a1758f38007d4278fa253c40c253439c3de9" exitCode=0
Oct 30 21:49:26.447779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.447684    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" event={"ID":"bc6bdcec-56f6-4690-9dba-b44e5ec73a62","Type":"ContainerDied","Data":"22bf9e6a7b372eb396d420b767a9a1758f38007d4278fa253c40c253439c3de9"}
Oct 30 21:49:26.449170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.449143    4943 generic.go:356] "Generic (PLEG): container finished" podID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerID="6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d" exitCode=0
Oct 30 21:49:26.449280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.449187    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"
Oct 30 21:49:26.449280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.449210    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" event={"ID":"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a","Type":"ContainerDied","Data":"6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d"}
Oct 30 21:49:26.449280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.449256    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9" event={"ID":"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a","Type":"ContainerDied","Data":"627919dd18c5fd01a575784651b34c93389eaf9a6b9f0673dc0803a8e229e793"}
Oct 30 21:49:26.449402 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.449286    4943 scope.go:122] "RemoveContainer" containerID="6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d"
Oct 30 21:49:26.460300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.460278    4943 scope.go:122] "RemoveContainer" containerID="6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d"
Oct 30 21:49:26.460705 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:49:26.460635    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d\": container with ID starting with 6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d not found: ID does not exist" containerID="6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d"
Oct 30 21:49:26.460705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.460672    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d"} err="failed to get container status \"6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d\": rpc error: code = NotFound desc = could not find container \"6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d\": container with ID starting with 6291a91e0323a1ae789acec2a6e4864d22ddc891e4b2d196021906d191306e9d not found: ID does not exist"
Oct 30 21:49:26.480664 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.480643    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:49:26.534268 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534239    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-podinfo\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534299    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istiod-ca-cert\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534367    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-certs\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534454    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-socket\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534520    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-data\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534726 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534679    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-certs" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.534798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534740    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-kube-api-access-mdjbd\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-kube-api-access-mdjbd\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534745    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-socket" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.534798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534788    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-token\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-token\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534808    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-data" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.534931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534825    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-credential-socket\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.534931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534730    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istiod-ca-cert" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:26.535083 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.534938    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-envoy\") pod \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\" (UID: \"c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a\") "
Oct 30 21:49:26.535083 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.535046    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-credential-socket" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.535502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.535482    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.535655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.535507    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.535655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.535523    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.535655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.535535    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.535655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.535548    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.537049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.537024    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-podinfo" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:49:26.537161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.537124    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-kube-api-access-mdjbd" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "kube-api-access-mdjbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:26.537161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.537126    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-envoy" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.537259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.537242    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-token" pod "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" (UID: "c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:26.637051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.636962    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-credential-socket\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637011    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-certs\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637070    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-token\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-token\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637130    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-socket\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637199    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-data\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637240    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-kube-api-access-prwn6\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-kube-api-access-prwn6\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637263    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-credential-socket" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.637599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637336    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istiod-ca-cert\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637418    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-podinfo\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637484    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-socket" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.637599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637495    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-data" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.637599 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637489    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-envoy\") pod \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\" (UID: \"bc6bdcec-56f6-4690-9dba-b44e5ec73a62\") "
Oct 30 21:49:26.637897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.637816    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istiod-ca-cert" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:49:26.638247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638215    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.638342 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638282    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdjbd\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-kube-api-access-mdjbd\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.638342 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638300    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.638342 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638313    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.638680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638348    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.638680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638364    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.638680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638377    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.638680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638390    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.639123 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.638675    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-certs" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.640192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.640158    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-podinfo" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:49:26.640292 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.640167    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-token" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:26.640680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.640659    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-kube-api-access-prwn6" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "kube-api-access-prwn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:49:26.641188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.641164    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-envoy" pod "bc6bdcec-56f6-4690-9dba-b44e5ec73a62" (UID: "bc6bdcec-56f6-4690-9dba-b44e5ec73a62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:49:26.739630 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.739588    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prwn6\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-kube-api-access-prwn6\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.739630 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.739618    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.739630 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.739632    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.739896 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.739644    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.739896 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.739658    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6bdcec-56f6-4690-9dba-b44e5ec73a62-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:49:26.889828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.889742    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"]
Oct 30 21:49:26.893627 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:26.893598    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-mjrm9"]
Oct 30 21:49:27.460070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:27.460038    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"
Oct 30 21:49:27.460551 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:27.460065    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs" event={"ID":"bc6bdcec-56f6-4690-9dba-b44e5ec73a62","Type":"ContainerDied","Data":"4a21462eb841ab6d10d25b9196ba3fc7a7ea62130ee5bfb73b1bf5b065f6d319"}
Oct 30 21:49:27.460551 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:27.460138    4943 scope.go:122] "RemoveContainer" containerID="22bf9e6a7b372eb396d420b767a9a1758f38007d4278fa253c40c253439c3de9"
Oct 30 21:49:27.619752 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:27.619715    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" path="/var/lib/kubelet/pods/c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a/volumes"
Oct 30 21:49:27.625351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:27.625322    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"]
Oct 30 21:49:27.674737 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:27.674706    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-9vmcs"]
Oct 30 21:49:29.590671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:29.588772    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:29.624273 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:29.624241    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" path="/var/lib/kubelet/pods/bc6bdcec-56f6-4690-9dba-b44e5ec73a62/volumes"
Oct 30 21:49:30.193466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:30.193428    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:30.939490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:30.939461    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:33.055606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:33.055549    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:34.384990 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:34.384959    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:34.560463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:34.560433    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:38.889785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:38.889746    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:39.100308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:39.100269    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:43.727170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:43.727135    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:47.474988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:47.474935    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:48.521347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:48.521297    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:51.063255 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:49:51.063220    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:49:53.047051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.047017    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"]
Oct 30 21:49:53.047953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.047929    4943 cpu_manager.go:414] "containerMap: removing container" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy"
Oct 30 21:49:53.048017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.047956    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy"
Oct 30 21:49:53.048017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.048014    4943 cpu_manager.go:414] "containerMap: removing container" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy"
Oct 30 21:49:53.048096 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.048022    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy"
Oct 30 21:49:53.048175 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.048163    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc6bdcec-56f6-4690-9dba-b44e5ec73a62" containerName="istio-proxy"
Oct 30 21:49:53.048210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.048185    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="c303bb6b-cedb-4bbb-a3e7-f1b3a0801a9a" containerName="istio-proxy"
Oct 30 21:49:53.053411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.053390    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.061796 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.061768    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.061934 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.061837    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4feca6-f04e-4a6b-8881-caadf0e5be58-openshift-service-ca\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.062008 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.061954    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-metrics-certs\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.062075 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.062010    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w9j8\" (UniqueName: \"kubernetes.io/projected/cd4feca6-f04e-4a6b-8881-caadf0e5be58-kube-api-access-6w9j8\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.106703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.106674    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"]
Oct 30 21:49:53.151725 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.151674    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-4a1551-serving-cert\""
Oct 30 21:49:53.163890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.163857    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.164014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.163962    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4feca6-f04e-4a6b-8881-caadf0e5be58-openshift-service-ca\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.164075 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.164013    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-metrics-certs\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.164075 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:49:53.164026    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-serving-cert: secret "maas-api-e2e-api-a-4a1551-serving-cert" not found
Oct 30 21:49:53.164075 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.164053    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w9j8\" (UniqueName: \"kubernetes.io/projected/cd4feca6-f04e-4a6b-8881-caadf0e5be58-kube-api-access-6w9j8\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.164238 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:49:53.164097    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls podName:cd4feca6-f04e-4a6b-8881-caadf0e5be58 nodeName:}" failed. No retries permitted until 2026-10-30 21:49:53.664077041 +0000 UTC m=+1988.159650373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls") pod "maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2" (UID: "cd4feca6-f04e-4a6b-8881-caadf0e5be58") : secret "maas-api-e2e-api-a-4a1551-serving-cert" not found
Oct 30 21:49:53.164690 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.164667    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4feca6-f04e-4a6b-8881-caadf0e5be58-openshift-service-ca\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.166419 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.166398    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-metrics-certs\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.221097 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.221067    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w9j8\" (UniqueName: \"kubernetes.io/projected/cd4feca6-f04e-4a6b-8881-caadf0e5be58-kube-api-access-6w9j8\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.300493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.300361    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:53.485319 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.485272    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:53.668963 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.668925    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:49:53.694912 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.694878    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.697323 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.697297    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls\") pod \"maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:53.969597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:53.969491    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:54.361068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:54.361019    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"]
Oct 30 21:49:54.361625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:54.361603    4943 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 30 21:49:54.723036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:54.723002    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2" event={"ID":"cd4feca6-f04e-4a6b-8881-caadf0e5be58","Type":"ContainerStarted","Data":"a23399d2e1d250d3fecfd8d70e04717835dfbc367d9e7002a3fa82adf2befbb6"}
Oct 30 21:49:55.731217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:55.731179    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2" event={"ID":"cd4feca6-f04e-4a6b-8881-caadf0e5be58","Type":"ContainerStarted","Data":"b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7"}
Oct 30 21:49:55.731740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:55.731239    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:49:55.848844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:55.848284    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2" podStartSLOduration=1.9821228899999999 podStartE2EDuration="2.848259094s" totalImagesPullingTime="866.136204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:49:55.844076173 +0000 UTC m=+1990.339649525" watchObservedRunningTime="2026-10-30 21:49:55.848259094 +0000 UTC m=+1990.343832446"
Oct 30 21:49:58.136103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:49:58.136062    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:01.743335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:01.743306    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:50:02.770256 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:02.770211    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:02.952516 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:02.952476    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:03.135647 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:03.135542    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:07.633416 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:07.633378    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:12.097003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.096968    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"]
Oct 30 21:50:12.101185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.101167    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.157464 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.157436    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"]
Oct 30 21:50:12.165967 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.165894    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-metrics-certs\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.166098 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.165997    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79108e33-0cde-4fb9-a87a-867f6e53915f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.166098 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.166064    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.166220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.166180    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv8v6\" (UniqueName: \"kubernetes.io/projected/79108e33-0cde-4fb9-a87a-867f6e53915f-kube-api-access-lv8v6\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.205040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.205012    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-50b188-serving-cert\""
Oct 30 21:50:12.267170 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.267138    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-metrics-certs\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.267408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.267180    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79108e33-0cde-4fb9-a87a-867f6e53915f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.267408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.267219    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.267408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.267249    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv8v6\" (UniqueName: \"kubernetes.io/projected/79108e33-0cde-4fb9-a87a-867f6e53915f-kube-api-access-lv8v6\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.267408 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:50:12.267385    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-serving-cert: secret "maas-api-e2e-inf-a-50b188-serving-cert" not found
Oct 30 21:50:12.267651 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:50:12.267458    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls podName:79108e33-0cde-4fb9-a87a-867f6e53915f nodeName:}" failed. No retries permitted until 2026-10-30 21:50:12.7674385 +0000 UTC m=+2007.263011836 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls") pod "maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" (UID: "79108e33-0cde-4fb9-a87a-867f6e53915f") : secret "maas-api-e2e-inf-a-50b188-serving-cert" not found
Oct 30 21:50:12.267890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.267869    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79108e33-0cde-4fb9-a87a-867f6e53915f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.269615 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.269597    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-metrics-certs\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.324250 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.324224    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv8v6\" (UniqueName: \"kubernetes.io/projected/79108e33-0cde-4fb9-a87a-867f6e53915f-kube-api-access-lv8v6\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.341894 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.341865    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:12.523186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.523144    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:12.773493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.773414    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:12.775907 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:12.775887    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls\") pod \"maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:13.015280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:13.015246    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:13.398435 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:13.398403    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"]
Oct 30 21:50:13.399143 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:50:13.399116    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79108e33_0cde_4fb9_a87a_867f6e53915f.slice/crio-9478445acefe9c03608ea2ca75455def4f427c7a0b413520e1fdf2b2850c41fd WatchSource:0}: Error finding container 9478445acefe9c03608ea2ca75455def4f427c7a0b413520e1fdf2b2850c41fd: Status 404 returned error can't find the container with id 9478445acefe9c03608ea2ca75455def4f427c7a0b413520e1fdf2b2850c41fd
Oct 30 21:50:13.862278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:13.862238    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:13.894731 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:13.894644    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" event={"ID":"79108e33-0cde-4fb9-a87a-867f6e53915f","Type":"ContainerStarted","Data":"9478445acefe9c03608ea2ca75455def4f427c7a0b413520e1fdf2b2850c41fd"}
Oct 30 21:50:14.622120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:14.622031    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:14.904595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:14.904208    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" event={"ID":"79108e33-0cde-4fb9-a87a-867f6e53915f","Type":"ContainerStarted","Data":"d319a10fcdf46c34fc8bc082cd311f9938688a7a44c91e9bb9459a29c76b0ae2"}
Oct 30 21:50:14.905146 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:14.905126    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:15.025519 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:15.025468    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" podStartSLOduration=2.206166596 podStartE2EDuration="3.025453885s" totalImagesPullingTime="819.287289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:15.02289161 +0000 UTC m=+2009.518464961" watchObservedRunningTime="2026-10-30 21:50:15.025453885 +0000 UTC m=+2009.521027235"
Oct 30 21:50:17.786471 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:17.786431    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:20.916445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:20.916410    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:50:21.080677 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:50:21.080638    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:50:22.959925 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:22.959884    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:25.130578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.113978    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"]
Oct 30 21:50:25.149985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.149940    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.203062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.203030    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-6b42c9-openshift-default-dockercfg-hdbh2\""
Oct 30 21:50:25.392834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392495    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-certs\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.392834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392567    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-token\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.392834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392702    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-socket\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.392834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392759    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-data\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.392834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392785    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-envoy\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.392834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392813    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-credential-socket\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.393278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392847    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06706923-8325-472a-9fb8-05f5ff6e0dab-istiod-ca-cert\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.393278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392885    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-podinfo\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.393278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.392914    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cd9h\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-kube-api-access-2cd9h\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.394585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.394472    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:25.449954 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.449919    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"]
Oct 30 21:50:25.494689 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.494650    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-podinfo\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.494884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.494699    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cd9h\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-kube-api-access-2cd9h\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.494884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.494776    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-certs\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.494884 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.494811    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-token\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.494949    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-socket\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495050 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495037    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-data\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495162 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495081    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-envoy\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495162 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495127    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-credential-socket\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495267 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495185    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06706923-8325-472a-9fb8-05f5ff6e0dab-istiod-ca-cert\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495267 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495250    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-certs\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495304    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-socket\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495453 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495440    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-data\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495550    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-credential-socket\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.495908 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.495888    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06706923-8325-472a-9fb8-05f5ff6e0dab-istiod-ca-cert\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.497311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.497286    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-envoy\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.497538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.497522    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-podinfo\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.563347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.563309    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cd9h\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-kube-api-access-2cd9h\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.566760 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.566709    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-token\") pod \"e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") " pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:25.661021 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.660988    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:25.798509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:25.798475    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:26.237259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:26.237231    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"]
Oct 30 21:50:26.237994 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:50:26.237961    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06706923_8325_472a_9fb8_05f5ff6e0dab.slice/crio-28b3fd45dd3b37f476957236f4db55d3f57a190a9c226679df67a46f9463756a WatchSource:0}: Error finding container 28b3fd45dd3b37f476957236f4db55d3f57a190a9c226679df67a46f9463756a: Status 404 returned error can't find the container with id 28b3fd45dd3b37f476957236f4db55d3f57a190a9c226679df67a46f9463756a
Oct 30 21:50:26.240748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:26.240714    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:50:26.240856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:26.240792    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:50:26.240856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:26.240837    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:50:27.008428 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:27.008390    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" event={"ID":"06706923-8325-472a-9fb8-05f5ff6e0dab","Type":"ContainerStarted","Data":"709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3"}
Oct 30 21:50:27.008674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:27.008461    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" event={"ID":"06706923-8325-472a-9fb8-05f5ff6e0dab","Type":"ContainerStarted","Data":"28b3fd45dd3b37f476957236f4db55d3f57a190a9c226679df67a46f9463756a"}
Oct 30 21:50:27.225670 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:27.225606    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" podStartSLOduration=2.225585666 podStartE2EDuration="2.225585666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:27.174399846 +0000 UTC m=+2021.669973198" watchObservedRunningTime="2026-10-30 21:50:27.225585666 +0000 UTC m=+2021.721159023"
Oct 30 21:50:27.799198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:27.799160    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:27.805975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:27.805948    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:27.904915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:27.904846    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:28.016901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:28.016869    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:28.017830 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:28.017808    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:50:30.299868 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:30.299837    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:30.502885 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:30.502844    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:30.714712 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:30.714682    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:33.086970 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:33.086931    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:33.276978 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:33.276941    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:33.635767 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:33.635733    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:33.837121 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:33.837081    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:38.545189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:38.545138    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:43.041589 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.041528    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"]
Oct 30 21:50:43.045537 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.045520    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.105094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.105061    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"]
Oct 30 21:50:43.153751 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.153719    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.153901 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.153791    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292ea458-d0ad-4357-b260-621f25104384-openshift-service-ca\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.153966 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.153949    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-metrics-certs\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.154024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.153981    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmpv\" (UniqueName: \"kubernetes.io/projected/292ea458-d0ad-4357-b260-621f25104384-kube-api-access-bsmpv\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.168710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.168683    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-1dc70e-serving-cert\""
Oct 30 21:50:43.255691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.255661    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmpv\" (UniqueName: \"kubernetes.io/projected/292ea458-d0ad-4357-b260-621f25104384-kube-api-access-bsmpv\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.255865 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.255789    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.255865 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.255831    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292ea458-d0ad-4357-b260-621f25104384-openshift-service-ca\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.255958 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:50:43.255938    4943 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-serving-cert: secret "maas-api-e2e-api-b-1dc70e-serving-cert" not found
Oct 30 21:50:43.255998 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:50:43.255993    4943 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls podName:292ea458-d0ad-4357-b260-621f25104384 nodeName:}" failed. No retries permitted until 2026-10-30 21:50:43.755979102 +0000 UTC m=+2038.251552447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls") pod "maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b" (UID: "292ea458-d0ad-4357-b260-621f25104384") : secret "maas-api-e2e-api-b-1dc70e-serving-cert" not found
Oct 30 21:50:43.256040 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.255944    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-metrics-certs\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.256659 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.256638    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292ea458-d0ad-4357-b260-621f25104384-openshift-service-ca\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.258394 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.258376    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-metrics-certs\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.288196 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.288174    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:43.312998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.312945    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmpv\" (UniqueName: \"kubernetes.io/projected/292ea458-d0ad-4357-b260-621f25104384-kube-api-access-bsmpv\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.474665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.474614    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:43.764498 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.764466    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.766842 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.766816    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls\") pod \"maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:43.960653 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:43.960622    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:44.353497 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:50:44.353467    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292ea458_d0ad_4357_b260_621f25104384.slice/crio-64ba3bd0ab2943d428f83c0f2176de173568ec8ff8110860417add1537a03de2 WatchSource:0}: Error finding container 64ba3bd0ab2943d428f83c0f2176de173568ec8ff8110860417add1537a03de2: Status 404 returned error can't find the container with id 64ba3bd0ab2943d428f83c0f2176de173568ec8ff8110860417add1537a03de2
Oct 30 21:50:44.353848 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:44.353614    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"]
Oct 30 21:50:45.162533 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:45.162499    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b" event={"ID":"292ea458-d0ad-4357-b260-621f25104384","Type":"ContainerStarted","Data":"64ba3bd0ab2943d428f83c0f2176de173568ec8ff8110860417add1537a03de2"}
Oct 30 21:50:46.182517 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:46.182469    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b" event={"ID":"292ea458-d0ad-4357-b260-621f25104384","Type":"ContainerStarted","Data":"e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a"}
Oct 30 21:50:46.183166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:46.182575    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:46.298080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:46.298012    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b" podStartSLOduration=3.461086142 podStartE2EDuration="4.297992582s" totalImagesPullingTime="836.90644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:50:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:50:46.297045312 +0000 UTC m=+2040.792618665" watchObservedRunningTime="2026-10-30 21:50:46.297992582 +0000 UTC m=+2040.793565934"
Oct 30 21:50:47.674625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:47.674582    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:48.322577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:48.318129    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:50.847698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:50.847669    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:51.065903 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:50:51.065862    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:50:51.079914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:51.079881    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:52.198603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:52.198573    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:50:53.331519 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:53.331479    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:58.124834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:58.124344    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:50:58.307639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:50:58.307607    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:02.791579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:02.791229    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:03.610208 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:03.610170    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:04.563141 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:04.563096    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:04.897332 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:04.897243    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:07.929969 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:07.929929    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:08.128679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:08.128643    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:08.732350 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:08.732306    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:08.941667 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:08.941573    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:12.560808 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:12.560774    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:12.751668 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:12.751631    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:13.470953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:13.470920    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:18.604145 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:18.604102    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:20.145229 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:20.145196    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:20.378169 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:20.378094    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:21.065492 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:51:21.065450    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:51:23.793782 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:23.793746    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:28.563010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:28.562968    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:29.135583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:29.135541    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"]
Oct 30 21:51:29.135794 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:29.135753    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" containerID="cri-o://2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45" gracePeriod=30
Oct 30 21:51:30.232011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:30.231967    4943 patch_prober.go:29] interesting pod/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:51:30.232403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:30.232038    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:51:33.392889 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:33.392849    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:34.417252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.417193    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:51:34.453443 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453412    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-credential-socket\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.453610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453449    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-kube-api-access-sc94k\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-kube-api-access-sc94k\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.453610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453524    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-data\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.453610 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453593    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-certs\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.453768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453618    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istiod-ca-cert\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.453768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453657    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-podinfo\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.453768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453715    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-socket\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.453768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453735    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-credential-socket" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:34.453768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453762    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-token\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-token\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.454039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453861    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-envoy\") pod \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\" (UID: \"a7608c03-f0cd-472b-b7bb-c2b8945fd70e\") "
Oct 30 21:51:34.454039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453860    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-data" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:34.454039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.453894    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-certs" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:34.454039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.454027    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-socket" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:34.454239 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.454090    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istiod-ca-cert" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:51:34.454643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.454616    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.454784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.454647    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.454784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.454664    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.454784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.454680    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.454784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.454697    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.455957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.455929    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-kube-api-access-sc94k" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "kube-api-access-sc94k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:34.456062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.456039    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-envoy" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:51:34.456192 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.456174    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-token" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:51:34.456427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.456409    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-podinfo" pod "a7608c03-f0cd-472b-b7bb-c2b8945fd70e" (UID: "a7608c03-f0cd-472b-b7bb-c2b8945fd70e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:51:34.555618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.555586    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.555618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.555616    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.555618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.555626    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.555849 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.555636    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sc94k\" (UniqueName: \"kubernetes.io/projected/a7608c03-f0cd-472b-b7bb-c2b8945fd70e-kube-api-access-sc94k\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:51:34.594740 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.594702    4943 generic.go:356] "Generic (PLEG): container finished" podID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerID="2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45" exitCode=0
Oct 30 21:51:34.594910 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.594751    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"
Oct 30 21:51:34.594910 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.594783    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" event={"ID":"a7608c03-f0cd-472b-b7bb-c2b8945fd70e","Type":"ContainerDied","Data":"2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45"}
Oct 30 21:51:34.594910 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.594842    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7" event={"ID":"a7608c03-f0cd-472b-b7bb-c2b8945fd70e","Type":"ContainerDied","Data":"3fabb3aff53a1e26e3c38382ba9e1989263190737b98a5f4e47ceb3fe3a4e600"}
Oct 30 21:51:34.594910 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.594872    4943 scope.go:122] "RemoveContainer" containerID="2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45"
Oct 30 21:51:34.610634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.610609    4943 scope.go:122] "RemoveContainer" containerID="2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45"
Oct 30 21:51:34.610948 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:51:34.610923    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45\": container with ID starting with 2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45 not found: ID does not exist" containerID="2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45"
Oct 30 21:51:34.611024 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.610962    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45"} err="failed to get container status \"2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45\": rpc error: code = NotFound desc = could not find container \"2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45\": container with ID starting with 2998324d3a3174412d5e772ec444eae2123a8ebe158a33d0fedad8eafc120e45 not found: ID does not exist"
Oct 30 21:51:34.761437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.761334    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"]
Oct 30 21:51:34.765001 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:34.764978    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rk2x7"]
Oct 30 21:51:35.622923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:35.622889    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" path="/var/lib/kubelet/pods/a7608c03-f0cd-472b-b7bb-c2b8945fd70e/volumes"
Oct 30 21:51:38.422215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:38.422181    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:41.075190 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:41.075139    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:43.726408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:43.726369    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:46.020449 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:46.020420    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:51:46.023020 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:46.022997    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:51:48.028670 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:48.028617    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:49.017010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:49.016975    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:51.064423 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:51:51.064384    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:51:52.053624 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:52.047519    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:52.228266 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:52.228209    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:54.167141 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:54.167059    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:56.771016 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:56.770921    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:56.951039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:56.950997    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:58.489245 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:58.489195    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:59.236947 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:59.236885    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:51:59.416699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:51:59.416655    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:04.236073 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:04.236035    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:08.945657 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:08.945549    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:13.718405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.718369    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"]
Oct 30 21:52:13.719293 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.719273    4943 cpu_manager.go:414] "containerMap: removing container" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy"
Oct 30 21:52:13.719383 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.719294    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy"
Oct 30 21:52:13.719509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.719496    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7608c03-f0cd-472b-b7bb-c2b8945fd70e" containerName="istio-proxy"
Oct 30 21:52:13.723612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.723591    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:13.776815 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.776791    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-6b42c9-serving-cert\""
Oct 30 21:52:13.781204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.781180    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"]
Oct 30 21:52:13.913850 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.913816    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-metrics-certs\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:13.914030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.913897    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:13.914030 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.913985    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-maas-api-tls\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:13.914168 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:13.914149    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz68j\" (UniqueName: \"kubernetes.io/projected/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-kube-api-access-pz68j\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.021629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.020607    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.021629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.020668    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-maas-api-tls\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.021629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.020814    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz68j\" (UniqueName: \"kubernetes.io/projected/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-kube-api-access-pz68j\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.021629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.020988    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-metrics-certs\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.025795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.025767    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.027429 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.027400    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-maas-api-tls\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.034356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.034322    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-metrics-certs\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.068896 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.068855    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:14.086333 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.086305    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz68j\" (UniqueName: \"kubernetes.io/projected/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-kube-api-access-pz68j\") pod \"maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.273437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.273358    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:14.338441 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.338412    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:14.723057 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:14.723029    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"]
Oct 30 21:52:14.723843 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:52:14.723817    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953ba15a_d86e_4b7b_88c2_d2d0b7f3896f.slice/crio-b9725351043a3979cf8cc42e56fadbfe98abcebbe3be55833b646fad7e741ca8 WatchSource:0}: Error finding container b9725351043a3979cf8cc42e56fadbfe98abcebbe3be55833b646fad7e741ca8: Status 404 returned error can't find the container with id b9725351043a3979cf8cc42e56fadbfe98abcebbe3be55833b646fad7e741ca8
Oct 30 21:52:15.045826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:15.045753    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm" event={"ID":"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f","Type":"ContainerStarted","Data":"b9725351043a3979cf8cc42e56fadbfe98abcebbe3be55833b646fad7e741ca8"}
Oct 30 21:52:16.056507 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:16.056463    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm" event={"ID":"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f","Type":"ContainerStarted","Data":"255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88"}
Oct 30 21:52:16.057162 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:16.057132    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:16.175381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:16.175323    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm" podStartSLOduration=2.386711452 podStartE2EDuration="3.175308374s" totalImagesPullingTime="788.596922ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:52:16.171691836 +0000 UTC m=+2130.667265188" watchObservedRunningTime="2026-10-30 21:52:16.175308374 +0000 UTC m=+2130.670881725"
Oct 30 21:52:19.459331 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:19.459279    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:21.064697 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:52:21.064655    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:52:21.464054 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:21.464019    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:21.651519 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:21.651487    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:22.094450 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:22.094423    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:52:24.011110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:24.011022    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:24.338975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:24.338891    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:24.967905 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:24.967820    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:27.521103 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:27.521059    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:27.730622 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:27.730580    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:30.102739 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:30.102689    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:35.505110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:35.505071    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:40.981579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:40.981351    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:46.312485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:46.312443    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:48.340587 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:48.340521    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:48.374513 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:48.374484    4943 generic.go:356] "Generic (PLEG): container finished" podID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerID="709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3" exitCode=0
Oct 30 21:52:48.374736 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:48.374722    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" event={"ID":"06706923-8325-472a-9fb8-05f5ff6e0dab","Type":"ContainerDied","Data":"709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3"}
Oct 30 21:52:48.375110 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:48.375095    4943 scope.go:122] "RemoveContainer" containerID="709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3"
Oct 30 21:52:48.377075 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:48.377047    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:52:48.377198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:48.377115    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:52:48.377198 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:48.377150    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:52:49.385393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:49.385354    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" event={"ID":"06706923-8325-472a-9fb8-05f5ff6e0dab","Type":"ContainerStarted","Data":"ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac"}
Oct 30 21:52:49.799269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:49.799230    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:52:49.799461 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:49.799378    4943 patch_prober.go:29] interesting pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 30 21:52:49.799461 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:49.799448    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 30 21:52:50.799260 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:50.799221    4943 patch_prober.go:29] interesting pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 30 21:52:50.799673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:50.799286    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 30 21:52:51.087866 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:52:51.087772    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:52:51.607125 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:51.607095    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:51.799094 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:51.799055    4943 patch_prober.go:29] interesting pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 30 21:52:51.799300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:51.799130    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 30 21:52:52.798962 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:52.798927    4943 patch_prober.go:29] interesting pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 30 21:52:52.799172 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:52.798994    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 30 21:52:53.799640 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:53.799607    4943 patch_prober.go:29] interesting pod/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused" start-of-body=
Oct 30 21:52:53.800120 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:53.799666    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.115:15021/healthz/ready\": dial tcp 10.132.0.115:15021: connect: connection refused"
Oct 30 21:52:54.804746 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:54.804713    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:52:54.805294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:54.805152    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:52:54.805878 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:54.805854    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:52:56.498520 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:56.498481    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:56.701887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:56.701847    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:52:56.905427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:52:56.905396    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:01.530578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:01.529330    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:06.424123 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:06.422535    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:10.596950 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:10.596903    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:12.167639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:12.167545    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:12.489161 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:12.489081    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:12.726074 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:12.726033    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:13.253791 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:13.253754    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:17.832106 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:17.832068    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:20.896654 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:20.896612    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:21.065103 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:53:21.065067    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:53:21.238853 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:21.238806    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:21.286675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:21.286640    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"]
Oct 30 21:53:21.286902 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:21.286880    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy" containerID="cri-o://416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920" gracePeriod=30
Oct 30 21:53:21.486682 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:21.486521    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:22.604199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:22.604165    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"]
Oct 30 21:53:22.604631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:22.604362    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2" podUID="cd4feca6-f04e-4a6b-8881-caadf0e5be58" containerName="maas-api" containerID="cri-o://b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7" gracePeriod=30
Oct 30 21:53:22.762142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:22.761967    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:23.081578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.078769    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:53:23.211753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.211718    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-metrics-certs\") pod \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") "
Oct 30 21:53:23.211950 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.211808    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cd4feca6-f04e-4a6b-8881-caadf0e5be58-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4feca6-f04e-4a6b-8881-caadf0e5be58-openshift-service-ca\") pod \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") "
Oct 30 21:53:23.211950 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.211914    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cd4feca6-f04e-4a6b-8881-caadf0e5be58-kube-api-access-6w9j8\" (UniqueName: \"kubernetes.io/projected/cd4feca6-f04e-4a6b-8881-caadf0e5be58-kube-api-access-6w9j8\") pod \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") "
Oct 30 21:53:23.212093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.212070    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls\") pod \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\" (UID: \"cd4feca6-f04e-4a6b-8881-caadf0e5be58\") "
Oct 30 21:53:23.212173 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.212120    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4feca6-f04e-4a6b-8881-caadf0e5be58-openshift-service-ca" pod "cd4feca6-f04e-4a6b-8881-caadf0e5be58" (UID: "cd4feca6-f04e-4a6b-8881-caadf0e5be58"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:53:23.212816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.212788    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4feca6-f04e-4a6b-8881-caadf0e5be58-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:23.214097 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.214065    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4feca6-f04e-4a6b-8881-caadf0e5be58-kube-api-access-6w9j8" pod "cd4feca6-f04e-4a6b-8881-caadf0e5be58" (UID: "cd4feca6-f04e-4a6b-8881-caadf0e5be58"). InnerVolumeSpecName "kube-api-access-6w9j8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:53:23.214228 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.214197    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-metrics-certs" pod "cd4feca6-f04e-4a6b-8881-caadf0e5be58" (UID: "cd4feca6-f04e-4a6b-8881-caadf0e5be58"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:53:23.214943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.214921    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls" pod "cd4feca6-f04e-4a6b-8881-caadf0e5be58" (UID: "cd4feca6-f04e-4a6b-8881-caadf0e5be58"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:53:23.314695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.314658    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:23.314695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.314690    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd4feca6-f04e-4a6b-8881-caadf0e5be58-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:23.314695 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.314702    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6w9j8\" (UniqueName: \"kubernetes.io/projected/cd4feca6-f04e-4a6b-8881-caadf0e5be58-kube-api-access-6w9j8\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:23.707581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.703583    4943 generic.go:356] "Generic (PLEG): container finished" podID="cd4feca6-f04e-4a6b-8881-caadf0e5be58" containerID="b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7" exitCode=0
Oct 30 21:53:23.707581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.703819    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2" event={"ID":"cd4feca6-f04e-4a6b-8881-caadf0e5be58","Type":"ContainerDied","Data":"b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7"}
Oct 30 21:53:23.707581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.703873    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2" event={"ID":"cd4feca6-f04e-4a6b-8881-caadf0e5be58","Type":"ContainerDied","Data":"a23399d2e1d250d3fecfd8d70e04717835dfbc367d9e7002a3fa82adf2befbb6"}
Oct 30 21:53:23.707581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.703902    4943 scope.go:122] "RemoveContainer" containerID="b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7"
Oct 30 21:53:23.707581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.704060    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"
Oct 30 21:53:23.797881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.797850    4943 scope.go:122] "RemoveContainer" containerID="b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7"
Oct 30 21:53:23.798591 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:53:23.798476    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7\": container with ID starting with b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7 not found: ID does not exist" containerID="b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7"
Oct 30 21:53:23.798591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.798521    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7"} err="failed to get container status \"b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7\": rpc error: code = NotFound desc = could not find container \"b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7\": container with ID starting with b6aeb50844b5a0d4d9ef9cee268d4d3c7c4c55cefb63d8530e7ff5a3913a7fc7 not found: ID does not exist"
Oct 30 21:53:23.881766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.881732    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"]
Oct 30 21:53:23.930216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:23.930178    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-4a1551-555bf57bc4-8dzh2"]
Oct 30 21:53:24.570441 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:24.570405    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:24.899023 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:24.897442    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:25.151353 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:25.151247    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:25.616224 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:25.616138    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:25.619541 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:25.619516    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cd4feca6-f04e-4a6b-8881-caadf0e5be58" path="/var/lib/kubelet/pods/cd4feca6-f04e-4a6b-8881-caadf0e5be58/volumes"
Oct 30 21:53:26.579900 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.579812    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:53:26.663886 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.663827    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-certs\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.663919    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-envoy\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.663962    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istiod-ca-cert\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664027    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-credential-socket\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664056    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-token\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-token\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664295 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664104    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-socket\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664295 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664110    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-certs" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:53:26.664295 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664257    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-data\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664300    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-credential-socket" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:53:26.664456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664323    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-kube-api-access-4x9ts\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-kube-api-access-4x9ts\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664366    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-socket" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:53:26.664456 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664394    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-podinfo\") pod \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\" (UID: \"0d1f2866-4f70-47c9-bdde-089dfcdf1521\") "
Oct 30 21:53:26.664694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664547    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-data" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:53:26.664694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.664680    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istiod-ca-cert" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:53:26.665264 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.665240    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.665338 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.665271    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.665338 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.665286    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.665338 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.665299    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.665338 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.665313    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.666928 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.666897    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-kube-api-access-4x9ts" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "kube-api-access-4x9ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:53:26.667056 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.666957    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-token" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:53:26.667056 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.667033    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-envoy" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:53:26.668055 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.668030    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-podinfo" pod "0d1f2866-4f70-47c9-bdde-089dfcdf1521" (UID: "0d1f2866-4f70-47c9-bdde-089dfcdf1521"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:53:26.728403 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.728358    4943 generic.go:356] "Generic (PLEG): container finished" podID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerID="416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920" exitCode=0
Oct 30 21:53:26.728603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.728415    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"
Oct 30 21:53:26.728603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.728437    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" event={"ID":"0d1f2866-4f70-47c9-bdde-089dfcdf1521","Type":"ContainerDied","Data":"416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920"}
Oct 30 21:53:26.728603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.728498    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf" event={"ID":"0d1f2866-4f70-47c9-bdde-089dfcdf1521","Type":"ContainerDied","Data":"4d66c9af990c71a7fe8232d38f30cfb9e911a5d15ede588ed280f06794cf59d2"}
Oct 30 21:53:26.728603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.728525    4943 scope.go:122] "RemoveContainer" containerID="416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920"
Oct 30 21:53:26.740932 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.740914    4943 scope.go:122] "RemoveContainer" containerID="416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920"
Oct 30 21:53:26.741235 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:53:26.741209    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920\": container with ID starting with 416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920 not found: ID does not exist" containerID="416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920"
Oct 30 21:53:26.741289 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.741246    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920"} err="failed to get container status \"416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920\": rpc error: code = NotFound desc = could not find container \"416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920\": container with ID starting with 416ce8d396346a50a8340b858993e198bfeb91804c2e8ebfb3fe7ebd94035920 not found: ID does not exist"
Oct 30 21:53:26.767446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.767399    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.767446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.767452    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.767693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.767470    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x9ts\" (UniqueName: \"kubernetes.io/projected/0d1f2866-4f70-47c9-bdde-089dfcdf1521-kube-api-access-4x9ts\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.767693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.767485    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d1f2866-4f70-47c9-bdde-089dfcdf1521-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:26.873605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.873518    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"]
Oct 30 21:53:26.879189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:26.879165    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w4-218800-openshift-default-7888c6d55c-zzlmf"]
Oct 30 21:53:27.619834 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:27.619802    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" path="/var/lib/kubelet/pods/0d1f2866-4f70-47c9-bdde-089dfcdf1521/volumes"
Oct 30 21:53:30.328270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:30.328198    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:32.283068 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:32.283031    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:32.494363 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:32.494326    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:32.731579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:32.723426    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:34.205511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:34.205461    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:34.397579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:34.397532    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:34.942320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:34.942288    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:35.718305 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.718258    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"]
Oct 30 21:53:35.719919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.719889    4943 cpu_manager.go:414] "containerMap: removing container" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy"
Oct 30 21:53:35.720082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.720066    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy"
Oct 30 21:53:35.720285 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.720271    4943 cpu_manager.go:414] "containerMap: removing container" podUID="cd4feca6-f04e-4a6b-8881-caadf0e5be58" containerName="maas-api"
Oct 30 21:53:35.720376 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.720363    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cd4feca6-f04e-4a6b-8881-caadf0e5be58" containerName="maas-api"
Oct 30 21:53:35.720687 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.720669    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d1f2866-4f70-47c9-bdde-089dfcdf1521" containerName="istio-proxy"
Oct 30 21:53:35.720822 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.720810    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="cd4feca6-f04e-4a6b-8881-caadf0e5be58" containerName="maas-api"
Oct 30 21:53:35.752951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.752917    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.794579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.772870    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-envoy\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.819656 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.819624    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6l9z\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-kube-api-access-g6l9z\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.819931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.819909    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504172ff-ddd4-4772-8a1d-674ab6557357-istio-podinfo\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.820132 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.820116    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-istio-token\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.820584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.820543    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-socket\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.820824 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.820807    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504172ff-ddd4-4772-8a1d-674ab6557357-istiod-ca-cert\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.823430 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.823406    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-data\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.823893 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.823875    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-certs\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.824098 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.824082    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-credential-socket\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.836418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.836394    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"]
Oct 30 21:53:35.900393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.900349    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e9aa8e-openshift-default-dockercfg-m9rg5\""
Oct 30 21:53:35.930576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.919181    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:35.937583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.928627    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-envoy\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.951568 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.937845    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6l9z\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-kube-api-access-g6l9z\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.952104 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.952070    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504172ff-ddd4-4772-8a1d-674ab6557357-istio-podinfo\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.952278 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.952253    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-istio-token\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.952405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.952383    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-socket\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.952577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.952543    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504172ff-ddd4-4772-8a1d-674ab6557357-istiod-ca-cert\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.952755 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.952731    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-data\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.953007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.952990    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-certs\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.953188 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.953160    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-credential-socket\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.953919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.953889    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-credential-socket\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.956841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.956813    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-envoy\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.957597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.957148    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504172ff-ddd4-4772-8a1d-674ab6557357-istio-podinfo\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.958089 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.958018    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-socket\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.958247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.957717    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504172ff-ddd4-4772-8a1d-674ab6557357-istiod-ca-cert\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.958379 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.958292    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-certs\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:35.958509 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:35.958455    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-data\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:36.018309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.018240    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-istio-token\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:36.023304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.023274    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6l9z\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-kube-api-access-g6l9z\") pod \"e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") " pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:36.136583 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.134792    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:36.158047 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.158014    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:36.617727 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.617693    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"]
Oct 30 21:53:36.623923 ip-10-0-135-205 kubenswrapper[4943]: W1030 21:53:36.623894    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504172ff_ddd4_4772_8a1d_674ab6557357.slice/crio-aefe0652d058b6587dbbb25bc36dc2418a37b95a9d4b3033313787dc623d2ed0 WatchSource:0}: Error finding container aefe0652d058b6587dbbb25bc36dc2418a37b95a9d4b3033313787dc623d2ed0: Status 404 returned error can't find the container with id aefe0652d058b6587dbbb25bc36dc2418a37b95a9d4b3033313787dc623d2ed0
Oct 30 21:53:36.627124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.627088    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:53:36.627243 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.627193    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:53:36.627309 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.627242    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:53:36.898221 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.898185    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" event={"ID":"504172ff-ddd4-4772-8a1d-674ab6557357","Type":"ContainerStarted","Data":"c1caf948ec563fc3ef5e90cd583f0f505d54b28cf78149ad2bbe32d6172e39b2"}
Oct 30 21:53:36.898738 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:36.898248    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" event={"ID":"504172ff-ddd4-4772-8a1d-674ab6557357","Type":"ContainerStarted","Data":"aefe0652d058b6587dbbb25bc36dc2418a37b95a9d4b3033313787dc623d2ed0"}
Oct 30 21:53:37.035186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:37.035077    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podStartSLOduration=2.035062776 podStartE2EDuration="2.035062776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 21:53:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 21:53:37.031389931 +0000 UTC m=+2211.526963283" watchObservedRunningTime="2026-10-30 21:53:37.035062776 +0000 UTC m=+2211.530636126"
Oct 30 21:53:37.135749 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:37.135703    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:37.137214 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:37.137185    4943 patch_prober.go:29] interesting pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 21:53:37.137351 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:37.137234    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 21:53:38.140713 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:38.140678    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:38.913737 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:38.913695    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:38.914794 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:38.914773    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:53:40.587272 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:40.587232    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"]
Oct 30 21:53:40.587798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:40.587500    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" podUID="79108e33-0cde-4fb9-a87a-867f6e53915f" containerName="maas-api" containerID="cri-o://d319a10fcdf46c34fc8bc082cd311f9938688a7a44c91e9bb9459a29c76b0ae2" gracePeriod=30
Oct 30 21:53:40.858496 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:40.857694    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:40.932137 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:40.932108    4943 generic.go:356] "Generic (PLEG): container finished" podID="79108e33-0cde-4fb9-a87a-867f6e53915f" containerID="d319a10fcdf46c34fc8bc082cd311f9938688a7a44c91e9bb9459a29c76b0ae2" exitCode=0
Oct 30 21:53:40.933045 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:40.933011    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" event={"ID":"79108e33-0cde-4fb9-a87a-867f6e53915f","Type":"ContainerDied","Data":"d319a10fcdf46c34fc8bc082cd311f9938688a7a44c91e9bb9459a29c76b0ae2"}
Oct 30 21:53:41.159601 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.159525    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:53:41.293316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.293280    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-metrics-certs\") pod \"79108e33-0cde-4fb9-a87a-867f6e53915f\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") "
Oct 30 21:53:41.293480 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.293364    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls\") pod \"79108e33-0cde-4fb9-a87a-867f6e53915f\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") "
Oct 30 21:53:41.293611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.293530    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79108e33-0cde-4fb9-a87a-867f6e53915f-kube-api-access-lv8v6\" (UniqueName: \"kubernetes.io/projected/79108e33-0cde-4fb9-a87a-867f6e53915f-kube-api-access-lv8v6\") pod \"79108e33-0cde-4fb9-a87a-867f6e53915f\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") "
Oct 30 21:53:41.293685 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.293649    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79108e33-0cde-4fb9-a87a-867f6e53915f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79108e33-0cde-4fb9-a87a-867f6e53915f-openshift-service-ca\") pod \"79108e33-0cde-4fb9-a87a-867f6e53915f\" (UID: \"79108e33-0cde-4fb9-a87a-867f6e53915f\") "
Oct 30 21:53:41.294174 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.294131    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79108e33-0cde-4fb9-a87a-867f6e53915f-openshift-service-ca" pod "79108e33-0cde-4fb9-a87a-867f6e53915f" (UID: "79108e33-0cde-4fb9-a87a-867f6e53915f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:53:41.294401 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.294381    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79108e33-0cde-4fb9-a87a-867f6e53915f-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:41.298602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.296355    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-metrics-certs" pod "79108e33-0cde-4fb9-a87a-867f6e53915f" (UID: "79108e33-0cde-4fb9-a87a-867f6e53915f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:53:41.298602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.296490    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79108e33-0cde-4fb9-a87a-867f6e53915f-kube-api-access-lv8v6" pod "79108e33-0cde-4fb9-a87a-867f6e53915f" (UID: "79108e33-0cde-4fb9-a87a-867f6e53915f"). InnerVolumeSpecName "kube-api-access-lv8v6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:53:41.298602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.297093    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls" pod "79108e33-0cde-4fb9-a87a-867f6e53915f" (UID: "79108e33-0cde-4fb9-a87a-867f6e53915f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:53:41.396011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.395900    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:41.396011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.395931    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79108e33-0cde-4fb9-a87a-867f6e53915f-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:41.396011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.395942    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv8v6\" (UniqueName: \"kubernetes.io/projected/79108e33-0cde-4fb9-a87a-867f6e53915f-kube-api-access-lv8v6\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:53:41.940703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.940673    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"
Oct 30 21:53:41.941166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.940678    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" event={"ID":"79108e33-0cde-4fb9-a87a-867f6e53915f","Type":"ContainerDied","Data":"9478445acefe9c03608ea2ca75455def4f427c7a0b413520e1fdf2b2850c41fd"}
Oct 30 21:53:41.941166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:41.940805    4943 scope.go:122] "RemoveContainer" containerID="d319a10fcdf46c34fc8bc082cd311f9938688a7a44c91e9bb9459a29c76b0ae2"
Oct 30 21:53:42.107980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:42.107946    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"]
Oct 30 21:53:42.155941 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:42.155909    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh"]
Oct 30 21:53:42.499246 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:42.499215    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:42.802737 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:42.802604    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:43.250010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:43.249970    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:43.551779 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:43.551685    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:43.619507 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:43.619473    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79108e33-0cde-4fb9-a87a-867f6e53915f" path="/var/lib/kubelet/pods/79108e33-0cde-4fb9-a87a-867f6e53915f/volumes"
Oct 30 21:53:43.916112 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:43.916074    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-50b188-54cfdd78b4-7qbbh" podUID="79108e33-0cde-4fb9-a87a-867f6e53915f" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.114:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 30 21:53:46.078232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:46.078194    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:46.313709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:46.313676    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:48.424726 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:48.424687    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:48.730839 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:48.730753    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:49.825140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:49.825109    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:50.074980 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:50.074947    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:50.309778 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:50.309741    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:51.067232 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:53:51.067185    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:53:53.360341 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:53.360305    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:57.624352 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:57.624302    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:59.222720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:59.222679    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:59.572026 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:59.571937    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:53:59.761540 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:53:59.761505    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:00.178989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:00.178918    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:00.418271 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:00.418237    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:02.132003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:02.131969    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:03.404879 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:03.404817    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:03.600518 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:03.600340    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:04.974735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:04.974689    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:07.234542 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:07.234508    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:07.537372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:07.537267    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:07.754667 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:07.754628    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:08.096578 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:08.091341    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:08.351842 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:08.351747    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"]
Oct 30 21:54:08.352338 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:08.352287    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" containerID="cri-o://823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0" gracePeriod=30
Oct 30 21:54:10.581870 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:10.581834    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:11.181302 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:11.181266    4943 patch_prober.go:29] interesting pod/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:54:11.181505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:11.181327    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:54:13.646084 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.646048    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:54:13.693669 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.693631    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-kube-api-access-nqnkm\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-kube-api-access-nqnkm\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.693855 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.693694    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-envoy\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.693931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.693874    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-socket\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.694000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.693960    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-podinfo\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.694069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.693997    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-credential-socket\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.694069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.694045    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-token\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-token\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.694181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.694088    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-certs\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.694181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.694154    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istiod-ca-cert\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.694304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.694198    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-data\") pod \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\" (UID: \"a5d04321-74c7-4770-bce8-0d4b0aaa21c4\") "
Oct 30 21:54:13.694304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.694223    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-socket" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:13.695721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.695471    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istiod-ca-cert" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:13.695973 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.695937    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-certs" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:13.696194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.696136    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-data" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:13.696194 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.696165    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-credential-socket" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:13.696939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.696782    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.696939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.696864    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.696939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.696882    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.696939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.696895    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.696939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.696908    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.697988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.697962    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-token" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:13.698315 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.698290    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-kube-api-access-nqnkm" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "kube-api-access-nqnkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:13.698397 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.698343    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-envoy" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:13.698455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.698443    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-podinfo" pod "a5d04321-74c7-4770-bce8-0d4b0aaa21c4" (UID: "a5d04321-74c7-4770-bce8-0d4b0aaa21c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:54:13.798404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.798374    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.798404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.798401    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.798404 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.798410    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:13.798639 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:13.798420    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqnkm\" (UniqueName: \"kubernetes.io/projected/a5d04321-74c7-4770-bce8-0d4b0aaa21c4-kube-api-access-nqnkm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:14.198076 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.198029    4943 generic.go:356] "Generic (PLEG): container finished" podID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerID="823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0" exitCode=0
Oct 30 21:54:14.198287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.198086    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"
Oct 30 21:54:14.198287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.198114    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" event={"ID":"a5d04321-74c7-4770-bce8-0d4b0aaa21c4","Type":"ContainerDied","Data":"823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0"}
Oct 30 21:54:14.198287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.198182    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8" event={"ID":"a5d04321-74c7-4770-bce8-0d4b0aaa21c4","Type":"ContainerDied","Data":"24172889dd148a0454898bcf8d989802cbea31563ab7f59ff211715a377fcdae"}
Oct 30 21:54:14.198287 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.198214    4943 scope.go:122] "RemoveContainer" containerID="823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0"
Oct 30 21:54:14.209495 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.209473    4943 scope.go:122] "RemoveContainer" containerID="823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0"
Oct 30 21:54:14.209774 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:54:14.209752    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0\": container with ID starting with 823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0 not found: ID does not exist" containerID="823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0"
Oct 30 21:54:14.209877 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.209780    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0"} err="failed to get container status \"823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0\": rpc error: code = NotFound desc = could not find container \"823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0\": container with ID starting with 823d776e9639d382efb1b2f0570abdb3cd1341619147c8b7a7adaa01056478d0 not found: ID does not exist"
Oct 30 21:54:14.378060 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.377608    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"]
Oct 30 21:54:14.383100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:14.381229    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-b64r8"]
Oct 30 21:54:15.495422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:15.495383    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"]
Oct 30 21:54:15.496303 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:15.496264    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy" containerID="cri-o://41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9" gracePeriod=30
Oct 30 21:54:15.577193 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:15.577160    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:15.621881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:15.621846    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" path="/var/lib/kubelet/pods/a5d04321-74c7-4770-bce8-0d4b0aaa21c4/volumes"
Oct 30 21:54:15.773536 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:15.773448    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:20.810149 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.810121    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:54:20.917376 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917339    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e6dac656-a08e-40ff-8671-0474c7652d40-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6dac656-a08e-40ff-8671-0474c7652d40-istio-podinfo\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917427    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e6dac656-a08e-40ff-8671-0474c7652d40-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6dac656-a08e-40ff-8671-0474c7652d40-istiod-ca-cert\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917476    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-envoy\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917499    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-data\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917524    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-istio-token\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-istio-token\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917606    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-credential-socket\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917671    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-socket\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917716    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-certs\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.917788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917750    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-kube-api-access-htl9m\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-kube-api-access-htl9m\") pod \"e6dac656-a08e-40ff-8671-0474c7652d40\" (UID: \"e6dac656-a08e-40ff-8671-0474c7652d40\") "
Oct 30 21:54:20.918006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917869    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-data" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:20.918006 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917923    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-credential-socket" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:20.918135 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.917988    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6dac656-a08e-40ff-8671-0474c7652d40-istiod-ca-cert" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:20.918135 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.918027    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-socket" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:20.918248 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.918178    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-certs" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:20.918445 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.918421    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e6dac656-a08e-40ff-8671-0474c7652d40-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:20.918619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.918450    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:20.918619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.918466    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:20.918619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.918482    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:20.918619 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.918496    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:20.919809 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.919787    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e6dac656-a08e-40ff-8671-0474c7652d40-istio-podinfo" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:54:20.920201 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.920184    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-kube-api-access-htl9m" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "kube-api-access-htl9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:20.920269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.920243    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-envoy" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:20.920366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:20.920345    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-istio-token" pod "e6dac656-a08e-40ff-8671-0474c7652d40" (UID: "e6dac656-a08e-40ff-8671-0474c7652d40"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:21.020210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.020128    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e6dac656-a08e-40ff-8671-0474c7652d40-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:21.020210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.020160    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:21.020210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.020175    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htl9m\" (UniqueName: \"kubernetes.io/projected/e6dac656-a08e-40ff-8671-0474c7652d40-kube-api-access-htl9m\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:21.020210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.020190    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e6dac656-a08e-40ff-8671-0474c7652d40-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:21.072165 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:54:21.072127    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:54:21.284703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.282258    4943 generic.go:356] "Generic (PLEG): container finished" podID="e6dac656-a08e-40ff-8671-0474c7652d40" containerID="41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9" exitCode=0
Oct 30 21:54:21.284703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.282466    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" event={"ID":"e6dac656-a08e-40ff-8671-0474c7652d40","Type":"ContainerDied","Data":"41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9"}
Oct 30 21:54:21.284703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.282571    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz" event={"ID":"e6dac656-a08e-40ff-8671-0474c7652d40","Type":"ContainerDied","Data":"57ad458fbdfed1c3151b1076fa1e731839814f9bddb762ed14ce13d3546676c6"}
Oct 30 21:54:21.284703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.282603    4943 scope.go:122] "RemoveContainer" containerID="41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9"
Oct 30 21:54:21.284703 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.282767    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"
Oct 30 21:54:21.303479 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.303399    4943 scope.go:122] "RemoveContainer" containerID="41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9"
Oct 30 21:54:21.303945 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:54:21.303921    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9\": container with ID starting with 41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9 not found: ID does not exist" containerID="41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9"
Oct 30 21:54:21.304063 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.303952    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9"} err="failed to get container status \"41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9\": rpc error: code = NotFound desc = could not find container \"41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9\": container with ID starting with 41ff3b6fe6b90defd427ff49f8bb64641c0a4cb9757c790c325884833b6932a9 not found: ID does not exist"
Oct 30 21:54:21.359957 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.359924    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:21.461891 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.461855    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"]
Oct 30 21:54:21.467273 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.467245    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-8bmpz"]
Oct 30 21:54:21.620466 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:21.620391    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" path="/var/lib/kubelet/pods/e6dac656-a08e-40ff-8671-0474c7652d40/volumes"
Oct 30 21:54:23.660579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:23.659947    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:23.888071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:23.888034    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:26.668726 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:26.659176    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:30.603086 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:30.603047    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:30.807409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:30.807360    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:31.188575 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:31.174537    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:32.093576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:32.092943    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:32.283000 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:32.282957    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:32.919333 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:32.919298    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.205486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:33.205391    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.412411 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:33.412377    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:33.838725 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:33.838689    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:35.238592 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:35.238539    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"]
Oct 30 21:54:35.239107 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:35.238886    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy" containerID="cri-o://6261f904939d975bcb124d5d73324eb205eb45b2cb6f9c96a42400a1db74a8bb" gracePeriod=30
Oct 30 21:54:35.288041 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:35.287988    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"]
Oct 30 21:54:35.288275 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:35.288246    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy" containerID="cri-o://9b605fea919a4488c257c6388aef7eaaeee1ae6403904a819ec628fbaca4c650" gracePeriod=30
Oct 30 21:54:37.830806 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:37.830771    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"]
Oct 30 21:54:37.831223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:37.830978    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst" podUID="59229a70-7f76-4df9-b52c-93ff26d3aac4" containerName="maas-api" containerID="cri-o://1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707" gracePeriod=30
Oct 30 21:54:37.973396 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:37.973363    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:38.208823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.208793    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:54:38.362606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.360723    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/59229a70-7f76-4df9-b52c-93ff26d3aac4-kube-api-access-8q4x6\" (UniqueName: \"kubernetes.io/projected/59229a70-7f76-4df9-b52c-93ff26d3aac4-kube-api-access-8q4x6\") pod \"59229a70-7f76-4df9-b52c-93ff26d3aac4\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") "
Oct 30 21:54:38.362606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.361083    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/59229a70-7f76-4df9-b52c-93ff26d3aac4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59229a70-7f76-4df9-b52c-93ff26d3aac4-openshift-service-ca\") pod \"59229a70-7f76-4df9-b52c-93ff26d3aac4\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") "
Oct 30 21:54:38.362606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.361232    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls\") pod \"59229a70-7f76-4df9-b52c-93ff26d3aac4\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") "
Oct 30 21:54:38.362606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.361439    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-metrics-certs\") pod \"59229a70-7f76-4df9-b52c-93ff26d3aac4\" (UID: \"59229a70-7f76-4df9-b52c-93ff26d3aac4\") "
Oct 30 21:54:38.364212 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.363624    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59229a70-7f76-4df9-b52c-93ff26d3aac4-openshift-service-ca" pod "59229a70-7f76-4df9-b52c-93ff26d3aac4" (UID: "59229a70-7f76-4df9-b52c-93ff26d3aac4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:38.367547 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.367518    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59229a70-7f76-4df9-b52c-93ff26d3aac4-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:38.389776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.384754    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls" pod "59229a70-7f76-4df9-b52c-93ff26d3aac4" (UID: "59229a70-7f76-4df9-b52c-93ff26d3aac4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:38.435308 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.435228    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-metrics-certs" pod "59229a70-7f76-4df9-b52c-93ff26d3aac4" (UID: "59229a70-7f76-4df9-b52c-93ff26d3aac4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:54:38.436221 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.436173    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59229a70-7f76-4df9-b52c-93ff26d3aac4-kube-api-access-8q4x6" pod "59229a70-7f76-4df9-b52c-93ff26d3aac4" (UID: "59229a70-7f76-4df9-b52c-93ff26d3aac4"). InnerVolumeSpecName "kube-api-access-8q4x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:38.468576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.467610    4943 generic.go:356] "Generic (PLEG): container finished" podID="59229a70-7f76-4df9-b52c-93ff26d3aac4" containerID="1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707" exitCode=0
Oct 30 21:54:38.468576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.467877    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst" event={"ID":"59229a70-7f76-4df9-b52c-93ff26d3aac4","Type":"ContainerDied","Data":"1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707"}
Oct 30 21:54:38.468576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.467982    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst" event={"ID":"59229a70-7f76-4df9-b52c-93ff26d3aac4","Type":"ContainerDied","Data":"2108805c3dd213b8b3c740acb97c3a9d33fd5a26b247735d4b303c201e6f91b9"}
Oct 30 21:54:38.468576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.468015    4943 scope.go:122] "RemoveContainer" containerID="1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707"
Oct 30 21:54:38.468576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.468238    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"
Oct 30 21:54:38.473744 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.473718    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q4x6\" (UniqueName: \"kubernetes.io/projected/59229a70-7f76-4df9-b52c-93ff26d3aac4-kube-api-access-8q4x6\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:38.473916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.473901    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:38.474019 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.474007    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59229a70-7f76-4df9-b52c-93ff26d3aac4-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:38.490007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.489984    4943 scope.go:122] "RemoveContainer" containerID="1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707"
Oct 30 21:54:38.490330 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:54:38.490302    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707\": container with ID starting with 1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707 not found: ID does not exist" containerID="1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707"
Oct 30 21:54:38.490408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.490340    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707"} err="failed to get container status \"1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707\": rpc error: code = NotFound desc = could not find container \"1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707\": container with ID starting with 1f6f56b88b4f340eb8d2132f107df3bdeda78dbddbbbb4daec330abbc53e0707 not found: ID does not exist"
Oct 30 21:54:38.639298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.639263    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"]
Oct 30 21:54:38.643989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:38.643961    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w1-2ace1d-5f59c65d57-5gwst"]
Oct 30 21:54:39.385088 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:39.385057    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:39.530364 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:39.530322    4943 patch_prober.go:29] interesting pod/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 21:54:39.530527 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:39.530396    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 21:54:39.582357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:39.582315    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:39.619282 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:39.619249    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="59229a70-7f76-4df9-b52c-93ff26d3aac4" path="/var/lib/kubelet/pods/59229a70-7f76-4df9-b52c-93ff26d3aac4/volumes"
Oct 30 21:54:39.787665 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:39.787624    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:39.999679 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:39.999635    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:40.218618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.218578    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:40.486903 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.486681    4943 generic.go:356] "Generic (PLEG): container finished" podID="7cf23461-e811-4fd6-8b06-6dae67380128" containerID="6261f904939d975bcb124d5d73324eb205eb45b2cb6f9c96a42400a1db74a8bb" exitCode=0
Oct 30 21:54:40.486903 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.486808    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" event={"ID":"7cf23461-e811-4fd6-8b06-6dae67380128","Type":"ContainerDied","Data":"6261f904939d975bcb124d5d73324eb205eb45b2cb6f9c96a42400a1db74a8bb"}
Oct 30 21:54:40.489953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.489756    4943 generic.go:356] "Generic (PLEG): container finished" podID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerID="9b605fea919a4488c257c6388aef7eaaeee1ae6403904a819ec628fbaca4c650" exitCode=0
Oct 30 21:54:40.489953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.489845    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" event={"ID":"9659aeba-2abf-4b52-9453-9bfbe0fc07c8","Type":"ContainerDied","Data":"9b605fea919a4488c257c6388aef7eaaeee1ae6403904a819ec628fbaca4c650"}
Oct 30 21:54:40.489953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.489884    4943 scope.go:122] "RemoveContainer" containerID="94d32d6b742b284954af759fb947d0e477720d2de3efcca535eed22383c79b1e"
Oct 30 21:54:40.595310 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.595282    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:54:40.618286 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.618265    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:54:40.634417 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.634394    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:40.706134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706097    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-envoy\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.706134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706136    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-kube-api-access-gz7z6\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-kube-api-access-gz7z6\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.706371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706177    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7cf23461-e811-4fd6-8b06-6dae67380128-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf23461-e811-4fd6-8b06-6dae67380128-istio-podinfo\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.706371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706209    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-envoy\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.706371 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706336    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-data\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.706499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706393    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-istio-token\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-istio-token\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.706499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706423    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-podinfo\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.706499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706459    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-socket\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.706699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706536    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7cf23461-e811-4fd6-8b06-6dae67380128-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf23461-e811-4fd6-8b06-6dae67380128-istiod-ca-cert\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.706699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.706601    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-certs\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.707069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707043    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-certs" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.707259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707238    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-data" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.707431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707409    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-kube-api-access-6bgtr\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-kube-api-access-6bgtr\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.707518 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707465    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-data\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.707518 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707507    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-socket\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.707672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707569    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-credential-socket\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.707672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707605    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-socket" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.707795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707671    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-token\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-token\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.707795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707702    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-credential-socket\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.707795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707733    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istiod-ca-cert\") pod \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\" (UID: \"9659aeba-2abf-4b52-9453-9bfbe0fc07c8\") "
Oct 30 21:54:40.707795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.707777    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-certs\") pod \"7cf23461-e811-4fd6-8b06-6dae67380128\" (UID: \"7cf23461-e811-4fd6-8b06-6dae67380128\") "
Oct 30 21:54:40.708091 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.708065    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-credential-socket" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.708499 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.708474    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istiod-ca-cert" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:40.709043 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709019    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-certs" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.709138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709044    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-data" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.709204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709185    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-credential-socket" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.709810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709657    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.709810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709683    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.709810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709698    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.709810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709712    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.709810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.709726    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.710372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.710354    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-socket" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.711053 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.711004    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cf23461-e811-4fd6-8b06-6dae67380128-istiod-ca-cert" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:54:40.712532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.712512    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-token" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:40.712940 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.712917    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-podinfo" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:54:40.713043 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.712943    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-istio-token" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:40.713043 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.712965    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-kube-api-access-gz7z6" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "kube-api-access-gz7z6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:40.713043 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.712971    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-envoy" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.713043 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.713036    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-kube-api-access-6bgtr" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "kube-api-access-6bgtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:54:40.713269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.713082    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-envoy" pod "9659aeba-2abf-4b52-9453-9bfbe0fc07c8" (UID: "9659aeba-2abf-4b52-9453-9bfbe0fc07c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:54:40.714045 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.714023    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7cf23461-e811-4fd6-8b06-6dae67380128-istio-podinfo" pod "7cf23461-e811-4fd6-8b06-6dae67380128" (UID: "7cf23461-e811-4fd6-8b06-6dae67380128"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:54:40.811946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.811865    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.811946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.811911    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.811946 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.811934    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.811948    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.811962    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz7z6\" (UniqueName: \"kubernetes.io/projected/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-kube-api-access-gz7z6\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.811978    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7cf23461-e811-4fd6-8b06-6dae67380128-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.811993    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.812007    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.812020    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9659aeba-2abf-4b52-9453-9bfbe0fc07c8-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.812037    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7cf23461-e811-4fd6-8b06-6dae67380128-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.812051    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bgtr\" (UniqueName: \"kubernetes.io/projected/7cf23461-e811-4fd6-8b06-6dae67380128-kube-api-access-6bgtr\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.812065    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.812144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.812079    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7cf23461-e811-4fd6-8b06-6dae67380128-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:54:40.857186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:40.857131    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:41.086305 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.086133    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:41.497935 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.497907    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"
Oct 30 21:54:41.497935 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.497928    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn" event={"ID":"7cf23461-e811-4fd6-8b06-6dae67380128","Type":"ContainerDied","Data":"64a5e35250cb8ed9b4d17f7fb9a6f6c3f8cce71b059886242aa6e4cf57fbc517"}
Oct 30 21:54:41.498477 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.497991    4943 scope.go:122] "RemoveContainer" containerID="6261f904939d975bcb124d5d73324eb205eb45b2cb6f9c96a42400a1db74a8bb"
Oct 30 21:54:41.499744 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.499712    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg" event={"ID":"9659aeba-2abf-4b52-9453-9bfbe0fc07c8","Type":"ContainerDied","Data":"64d1d194184552b94571a580ddec36de0ff87f26d2f4db4ec6a179240551143d"}
Oct 30 21:54:41.499868 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.499801    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"
Oct 30 21:54:41.510823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.510806    4943 scope.go:122] "RemoveContainer" containerID="9b605fea919a4488c257c6388aef7eaaeee1ae6403904a819ec628fbaca4c650"
Oct 30 21:54:41.663100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.663066    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"]
Oct 30 21:54:41.712824 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.712789    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-7hncg"]
Oct 30 21:54:41.775254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.775179    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"]
Oct 30 21:54:41.784365 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:41.784334    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w1-3ddec2-openshift-default-6b7895b7b5-fk6hn"]
Oct 30 21:54:42.643080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:42.643041    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:43.619324 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:43.619282    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" path="/var/lib/kubelet/pods/7cf23461-e811-4fd6-8b06-6dae67380128/volumes"
Oct 30 21:54:43.619903 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:43.619881    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" path="/var/lib/kubelet/pods/9659aeba-2abf-4b52-9453-9bfbe0fc07c8/volumes"
Oct 30 21:54:45.023920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:45.023882    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:45.242930 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:45.242886    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:45.443244 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:45.443205    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:45.838880 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:45.838804    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:47.566247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:47.566214    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"]
Oct 30 21:54:47.594574 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:47.592854    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:47.621099 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:47.621066    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"]
Oct 30 21:54:47.877277 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:47.877184    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:48.124114 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:48.124080    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:49.074248 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:49.074210    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:50.023609 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:50.023488    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:51.087140 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:54:51.087097    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:54:51.866039 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:51.866004    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:52.093326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:52.093292    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:52.287528 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:52.287492    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:55.007745 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:55.007689    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:55.202092 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:55.202052    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:54:57.571269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:54:57.571160    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:01.575311 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:01.575267    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"]
Oct 30 21:55:01.575850 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:01.575502    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl" podUID="be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" containerName="maas-api" containerID="cri-o://290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce" gracePeriod=30
Oct 30 21:55:01.724875 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:01.724842    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:02.042614 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.041539    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:55:02.185744 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.185655    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-kube-api-access-q2tbg\" (UniqueName: \"kubernetes.io/projected/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-kube-api-access-q2tbg\") pod \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") "
Oct 30 21:55:02.185936 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.185861    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls\") pod \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") "
Oct 30 21:55:02.185936 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.185904    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-metrics-certs\") pod \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") "
Oct 30 21:55:02.186069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.185935    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-openshift-service-ca\") pod \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\" (UID: \"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603\") "
Oct 30 21:55:02.187137 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.186824    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-openshift-service-ca" pod "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" (UID: "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:55:02.197247 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.197200    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-kube-api-access-q2tbg" pod "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" (UID: "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603"). InnerVolumeSpecName "kube-api-access-q2tbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:02.197468 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.197451    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls" pod "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" (UID: "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:02.198871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.198842    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-metrics-certs" pod "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" (UID: "be1d5ce2-ca46-4191-b1f3-9f81e8ed4603"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:02.287641 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.287605    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2tbg\" (UniqueName: \"kubernetes.io/projected/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-kube-api-access-q2tbg\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:02.287641 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.287639    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:02.287641 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.287650    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:02.287977 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.287660    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:02.641710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.628771    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main" containerID="cri-o://bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939" gracePeriod=45
Oct 30 21:55:02.660065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.658801    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main" containerID="cri-o://91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35" gracePeriod=45
Oct 30 21:55:02.687577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.686679    4943 generic.go:356] "Generic (PLEG): container finished" podID="be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" containerID="290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce" exitCode=0
Oct 30 21:55:02.687577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.686936    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl" event={"ID":"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603","Type":"ContainerDied","Data":"290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce"}
Oct 30 21:55:02.687577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.686986    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl" event={"ID":"be1d5ce2-ca46-4191-b1f3-9f81e8ed4603","Type":"ContainerDied","Data":"8b8a9f27c01e7ac48820070ed40b41bb81c129db2172903408d726452c84ef55"}
Oct 30 21:55:02.687577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.687014    4943 scope.go:122] "RemoveContainer" containerID="290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce"
Oct 30 21:55:02.687577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.687182    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"
Oct 30 21:55:02.800796 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.800762    4943 scope.go:122] "RemoveContainer" containerID="290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce"
Oct 30 21:55:02.802357 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:02.801164    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce\": container with ID starting with 290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce not found: ID does not exist" containerID="290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce"
Oct 30 21:55:02.802357 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.801209    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce"} err="failed to get container status \"290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce\": rpc error: code = NotFound desc = could not find container \"290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce\": container with ID starting with 290d25e0528307001926f4739b3d2acd4e78bcab76b9c9f4fd2064e6040ef1ce not found: ID does not exist"
Oct 30 21:55:02.907915 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.907846    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"]
Oct 30 21:55:02.911408 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:02.911381    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-fbb72e-6b784cfff9-tntcl"]
Oct 30 21:55:03.032337 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.032310    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:55:03.048418 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.048395    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:55:03.202747 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.202662    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/585621e7-232f-46fd-a918-e102b539c9d3-tls-certs\" (UniqueName: \"kubernetes.io/secret/585621e7-232f-46fd-a918-e102b539c9d3-tls-certs\") pod \"585621e7-232f-46fd-a918-e102b539c9d3\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") "
Oct 30 21:55:03.202991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.202972    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/585621e7-232f-46fd-a918-e102b539c9d3-kube-api-access-cv4bk\" (UniqueName: \"kubernetes.io/projected/585621e7-232f-46fd-a918-e102b539c9d3-kube-api-access-cv4bk\") pod \"585621e7-232f-46fd-a918-e102b539c9d3\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") "
Oct 30 21:55:03.203138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.203122    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-model-cache\") pod \"3c6000b6-eebe-41da-981f-f1e9307089f6\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") "
Oct 30 21:55:03.203263 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.203249    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-dshm\") pod \"3c6000b6-eebe-41da-981f-f1e9307089f6\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") "
Oct 30 21:55:03.203385 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.203371    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c6000b6-eebe-41da-981f-f1e9307089f6-kube-api-access-rg78j\" (UniqueName: \"kubernetes.io/projected/3c6000b6-eebe-41da-981f-f1e9307089f6-kube-api-access-rg78j\") pod \"3c6000b6-eebe-41da-981f-f1e9307089f6\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") "
Oct 30 21:55:03.203520 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.203505    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-dshm\") pod \"585621e7-232f-46fd-a918-e102b539c9d3\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") "
Oct 30 21:55:03.203688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.203675    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-tmp-dir\") pod \"585621e7-232f-46fd-a918-e102b539c9d3\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") "
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204176    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3c6000b6-eebe-41da-981f-f1e9307089f6-tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6000b6-eebe-41da-981f-f1e9307089f6-tls-certs\") pod \"3c6000b6-eebe-41da-981f-f1e9307089f6\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") "
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204217    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-tmp-dir\") pod \"3c6000b6-eebe-41da-981f-f1e9307089f6\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") "
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204352    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-home\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-home\") pod \"3c6000b6-eebe-41da-981f-f1e9307089f6\" (UID: \"3c6000b6-eebe-41da-981f-f1e9307089f6\") "
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204434    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-home\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-home\") pod \"585621e7-232f-46fd-a918-e102b539c9d3\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") "
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204490    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-model-cache\") pod \"585621e7-232f-46fd-a918-e102b539c9d3\" (UID: \"585621e7-232f-46fd-a918-e102b539c9d3\") "
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.203996    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-model-cache" pod "3c6000b6-eebe-41da-981f-f1e9307089f6" (UID: "3c6000b6-eebe-41da-981f-f1e9307089f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.205157    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-model-cache" pod "585621e7-232f-46fd-a918-e102b539c9d3" (UID: "585621e7-232f-46fd-a918-e102b539c9d3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204630    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-tmp-dir" pod "585621e7-232f-46fd-a918-e102b539c9d3" (UID: "585621e7-232f-46fd-a918-e102b539c9d3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204831    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-home" pod "3c6000b6-eebe-41da-981f-f1e9307089f6" (UID: "3c6000b6-eebe-41da-981f-f1e9307089f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.204984    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-home" pod "585621e7-232f-46fd-a918-e102b539c9d3" (UID: "585621e7-232f-46fd-a918-e102b539c9d3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.205423 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.205245    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.206117 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.205469    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-tmp-dir" pod "3c6000b6-eebe-41da-981f-f1e9307089f6" (UID: "3c6000b6-eebe-41da-981f-f1e9307089f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.207257 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.207150    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585621e7-232f-46fd-a918-e102b539c9d3-kube-api-access-cv4bk" pod "585621e7-232f-46fd-a918-e102b539c9d3" (UID: "585621e7-232f-46fd-a918-e102b539c9d3"). InnerVolumeSpecName "kube-api-access-cv4bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:03.207984 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.207951    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c6000b6-eebe-41da-981f-f1e9307089f6-kube-api-access-rg78j" pod "3c6000b6-eebe-41da-981f-f1e9307089f6" (UID: "3c6000b6-eebe-41da-981f-f1e9307089f6"). InnerVolumeSpecName "kube-api-access-rg78j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:03.208232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.208206    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c6000b6-eebe-41da-981f-f1e9307089f6-tls-certs" pod "3c6000b6-eebe-41da-981f-f1e9307089f6" (UID: "3c6000b6-eebe-41da-981f-f1e9307089f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:03.208962 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.208939    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-dshm" pod "585621e7-232f-46fd-a918-e102b539c9d3" (UID: "585621e7-232f-46fd-a918-e102b539c9d3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.209201 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.209157    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/585621e7-232f-46fd-a918-e102b539c9d3-tls-certs" pod "585621e7-232f-46fd-a918-e102b539c9d3" (UID: "585621e7-232f-46fd-a918-e102b539c9d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:03.209290 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.209234    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-dshm" pod "3c6000b6-eebe-41da-981f-f1e9307089f6" (UID: "3c6000b6-eebe-41da-981f-f1e9307089f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:03.290483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.290413    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.307951 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.307920    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585621e7-232f-46fd-a918-e102b539c9d3-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308186 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308166    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv4bk\" (UniqueName: \"kubernetes.io/projected/585621e7-232f-46fd-a918-e102b539c9d3-kube-api-access-cv4bk\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308299 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308286    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308399 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308386    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rg78j\" (UniqueName: \"kubernetes.io/projected/3c6000b6-eebe-41da-981f-f1e9307089f6-kube-api-access-rg78j\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308485 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308474    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308620 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308605    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308720    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c6000b6-eebe-41da-981f-f1e9307089f6-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308897 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308881    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.308993 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.308982    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c6000b6-eebe-41da-981f-f1e9307089f6-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.309080 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.309070    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.309166 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.309155    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585621e7-232f-46fd-a918-e102b539c9d3-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:03.514363 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.514275    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.652283 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.652217    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" path="/var/lib/kubelet/pods/be1d5ce2-ca46-4191-b1f3-9f81e8ed4603/volumes"
Oct 30 21:55:03.713304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.713266    4943 generic.go:356] "Generic (PLEG): container finished" podID="585621e7-232f-46fd-a918-e102b539c9d3" containerID="bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939" exitCode=0
Oct 30 21:55:03.713490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.713337    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"
Oct 30 21:55:03.713490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.713347    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" event={"ID":"585621e7-232f-46fd-a918-e102b539c9d3","Type":"ContainerDied","Data":"bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939"}
Oct 30 21:55:03.713490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.713394    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm" event={"ID":"585621e7-232f-46fd-a918-e102b539c9d3","Type":"ContainerDied","Data":"db0f9b8ca4e4a63507d3987fd95af81568da1cb882c8cac7f5816034dabfb823"}
Oct 30 21:55:03.713490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.713414    4943 scope.go:122] "RemoveContainer" containerID="bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939"
Oct 30 21:55:03.717887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.717299    4943 generic.go:356] "Generic (PLEG): container finished" podID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerID="91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35" exitCode=0
Oct 30 21:55:03.717887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.717353    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" event={"ID":"3c6000b6-eebe-41da-981f-f1e9307089f6","Type":"ContainerDied","Data":"91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35"}
Oct 30 21:55:03.717887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.717380    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j" event={"ID":"3c6000b6-eebe-41da-981f-f1e9307089f6","Type":"ContainerDied","Data":"030fa9cd2361a6d2fd729fa7fa24d4f885621c5d4698dc6abfadc21380e8d396"}
Oct 30 21:55:03.717887 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.717449    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"
Oct 30 21:55:03.722145 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.722119    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:03.749816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.733305    4943 scope.go:122] "RemoveContainer" containerID="bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939"
Oct 30 21:55:03.749816 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:03.733603    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939\": container with ID starting with bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939 not found: ID does not exist" containerID="bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939"
Oct 30 21:55:03.749816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.733637    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939"} err="failed to get container status \"bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939\": rpc error: code = NotFound desc = could not find container \"bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939\": container with ID starting with bb9b9a92cadc7c0827f35ed5ce5f2103a5ade8eb8420032e7873a41d6bbf7939 not found: ID does not exist"
Oct 30 21:55:03.749816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.733659    4943 scope.go:122] "RemoveContainer" containerID="91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35"
Oct 30 21:55:03.749816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.746915    4943 scope.go:122] "RemoveContainer" containerID="91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35"
Oct 30 21:55:03.749816 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:03.747173    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35\": container with ID starting with 91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35 not found: ID does not exist" containerID="91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35"
Oct 30 21:55:03.749816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.747202    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35"} err="failed to get container status \"91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35\": rpc error: code = NotFound desc = could not find container \"91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35\": container with ID starting with 91312b78e41582cd2c5cea56a44dcd8a3d0625ca4bf93589a8e0f663ca903e35 not found: ID does not exist"
Oct 30 21:55:03.880512 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.880426    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"]
Oct 30 21:55:03.887502 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.887472    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/distinct-2-w3-9796f1-kserve-6b9b6fbfc9-6lrgm"]
Oct 30 21:55:03.997973 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:03.997727    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"]
Oct 30 21:55:04.001144 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:04.001120    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-9796f1/premium-w3-9796f1-kserve-75465fc489-wr99j"]
Oct 30 21:55:04.358687 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:04.358651    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:05.620064 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:05.620033    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" path="/var/lib/kubelet/pods/3c6000b6-eebe-41da-981f-f1e9307089f6/volumes"
Oct 30 21:55:05.620523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:05.620508    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="585621e7-232f-46fd-a918-e102b539c9d3" path="/var/lib/kubelet/pods/585621e7-232f-46fd-a918-e102b539c9d3/volumes"
Oct 30 21:55:07.450746 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:07.450705    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:07.656872 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:07.656825    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:08.848579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:08.848529    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:09.088041 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:09.087999    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:10.926075 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:10.926031    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:11.117297 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:11.117263    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:11.232093 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:11.232006    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"]
Oct 30 21:55:11.232333 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:11.232287    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy" containerID="cri-o://c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745" gracePeriod=30
Oct 30 21:55:11.376252 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:11.376205    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:12.717169 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:12.717131    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:14.437702 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:14.434506    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:16.525867 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.525841    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:55:16.647150 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647117    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-data\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647252    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-socket\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647298    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-podinfo\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647330    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istiod-ca-cert\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647362    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-envoy\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647419    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-data" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:16.647546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647440    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-kube-api-access-ppp88\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-kube-api-access-ppp88\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647476    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-credential-socket\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647546 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647538    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-token\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-token\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647836 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647598    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-certs\") pod \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\" (UID: \"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444\") "
Oct 30 21:55:16.647836 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647614    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-socket" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:16.647945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.647895    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-certs" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:16.648062 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.648041    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.648124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.648062    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-credential-socket" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:16.648124 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.648069    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.648232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.648126    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.648455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.648430    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istiod-ca-cert" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:55:16.649937 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.649910    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-token" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:16.650145 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.650119    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-envoy" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:55:16.650424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.650394    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-kube-api-access-ppp88" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "kube-api-access-ppp88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:16.650625 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.650604    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-podinfo" pod "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" (UID: "ce22d8b2-120f-4a21-ae8f-4b30f3ea5444"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:55:16.749313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.749230    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppp88\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-kube-api-access-ppp88\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.749313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.749270    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.749313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.749286    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.749313 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.749304    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.749591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.749317    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.749591 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.749331    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:16.820455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.820408    4943 generic.go:356] "Generic (PLEG): container finished" podID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerID="c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745" exitCode=0
Oct 30 21:55:16.820455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.820465    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"
Oct 30 21:55:16.820691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.820492    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" event={"ID":"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444","Type":"ContainerDied","Data":"c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745"}
Oct 30 21:55:16.820691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.820580    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc" event={"ID":"ce22d8b2-120f-4a21-ae8f-4b30f3ea5444","Type":"ContainerDied","Data":"6931c58515994c7592b1a9de85e76697feedccc914462b986e0ebf288a48649c"}
Oct 30 21:55:16.820691 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.820604    4943 scope.go:122] "RemoveContainer" containerID="c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745"
Oct 30 21:55:16.831919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.831891    4943 scope.go:122] "RemoveContainer" containerID="effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5"
Oct 30 21:55:16.841288 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.841269    4943 scope.go:122] "RemoveContainer" containerID="c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745"
Oct 30 21:55:16.841567 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:16.841535    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745\": container with ID starting with c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745 not found: ID does not exist" containerID="c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745"
Oct 30 21:55:16.841650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.841582    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745"} err="failed to get container status \"c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745\": rpc error: code = NotFound desc = could not find container \"c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745\": container with ID starting with c2d17f01d7f2efc0e622370a02f5d928b6bbcf4c6e1a17f5b4a9598f3bac7745 not found: ID does not exist"
Oct 30 21:55:16.841650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.841609    4943 scope.go:122] "RemoveContainer" containerID="effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5"
Oct 30 21:55:16.841858 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:16.841839    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5\": container with ID starting with effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5 not found: ID does not exist" containerID="effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5"
Oct 30 21:55:16.841899 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.841865    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5"} err="failed to get container status \"effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5\": rpc error: code = NotFound desc = could not find container \"effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5\": container with ID starting with effbe53cccb478bf131519858adeb177fce5239f93609c2f54c782cff2d1caa5 not found: ID does not exist"
Oct 30 21:55:16.985923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.985893    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"]
Oct 30 21:55:16.992359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:16.992332    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fbb72e-openshift-default-cf57d8c7-lmzxc"]
Oct 30 21:55:17.619416 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:17.619381    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" path="/var/lib/kubelet/pods/ce22d8b2-120f-4a21-ae8f-4b30f3ea5444/volumes"
Oct 30 21:55:18.724083 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:18.724049    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:18.931199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:18.931167    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:19.157207 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:19.157147    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:19.689215 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:19.689168    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:20.329489 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:20.329448    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:21.068583 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:21.068529    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:55:21.239911 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:21.239876    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:21.458579 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:21.453586    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:23.821438 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:23.821397    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:24.023270 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:24.023209    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:24.555173 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:24.555137    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:24.987400 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:24.987363    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:25.181424 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:25.181354    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:26.568664 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:26.568631    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:26.752033 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:26.751976    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:29.727581 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:29.727526    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:29.929082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:29.929047    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:32.720379 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:32.720338    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:35.112732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:35.112687    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:40.115041 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:40.114187    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:44.909753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:44.909714    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:49.399292 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:49.399257    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:49.816284 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:49.816059    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:51.089392 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:51.089353    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:55:54.298363 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:54.298328    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:55.362389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.362360    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"]
Oct 30 21:55:55.362814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.362611    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z" podUID="79ff8730-c6df-48ef-8d3e-1378b522a7dd" containerName="maas-api" containerID="cri-o://158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61" gracePeriod=30
Oct 30 21:55:55.521177 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.521101    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:55.691208 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.691180    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:55:55.792975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.791776    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls\") pod \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") "
Oct 30 21:55:55.792975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.791902    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79ff8730-c6df-48ef-8d3e-1378b522a7dd-kube-api-access-rt86r\" (UniqueName: \"kubernetes.io/projected/79ff8730-c6df-48ef-8d3e-1378b522a7dd-kube-api-access-rt86r\") pod \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") "
Oct 30 21:55:55.792975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.791961    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-metrics-certs\") pod \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") "
Oct 30 21:55:55.792975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.792052    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79ff8730-c6df-48ef-8d3e-1378b522a7dd-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ff8730-c6df-48ef-8d3e-1378b522a7dd-openshift-service-ca\") pod \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\" (UID: \"79ff8730-c6df-48ef-8d3e-1378b522a7dd\") "
Oct 30 21:55:55.794206 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.794153    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ff8730-c6df-48ef-8d3e-1378b522a7dd-openshift-service-ca" pod "79ff8730-c6df-48ef-8d3e-1378b522a7dd" (UID: "79ff8730-c6df-48ef-8d3e-1378b522a7dd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:55:55.798620 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.798475    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ff8730-c6df-48ef-8d3e-1378b522a7dd-kube-api-access-rt86r" pod "79ff8730-c6df-48ef-8d3e-1378b522a7dd" (UID: "79ff8730-c6df-48ef-8d3e-1378b522a7dd"). InnerVolumeSpecName "kube-api-access-rt86r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:55:55.800017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.799979    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-metrics-certs" pod "79ff8730-c6df-48ef-8d3e-1378b522a7dd" (UID: "79ff8730-c6df-48ef-8d3e-1378b522a7dd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:55.800233 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.800195    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls" pod "79ff8730-c6df-48ef-8d3e-1378b522a7dd" (UID: "79ff8730-c6df-48ef-8d3e-1378b522a7dd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:55:55.887142 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.887103    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:55.893831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.893798    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt86r\" (UniqueName: \"kubernetes.io/projected/79ff8730-c6df-48ef-8d3e-1378b522a7dd-kube-api-access-rt86r\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:55.893831 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.893833    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:55.894028 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.893849    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79ff8730-c6df-48ef-8d3e-1378b522a7dd-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:55.894028 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:55.893863    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79ff8730-c6df-48ef-8d3e-1378b522a7dd-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:55:56.222991 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.222955    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:56.366710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.366017    4943 generic.go:356] "Generic (PLEG): container finished" podID="79ff8730-c6df-48ef-8d3e-1378b522a7dd" containerID="158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61" exitCode=0
Oct 30 21:55:56.366710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.366161    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z" event={"ID":"79ff8730-c6df-48ef-8d3e-1378b522a7dd","Type":"ContainerDied","Data":"158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61"}
Oct 30 21:55:56.366710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.366212    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z" event={"ID":"79ff8730-c6df-48ef-8d3e-1378b522a7dd","Type":"ContainerDied","Data":"d9529241d07fa29d3d5811e54598c6be2a18bb7a634da0e46815f351c8a8f5ab"}
Oct 30 21:55:56.366710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.366244    4943 scope.go:122] "RemoveContainer" containerID="158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61"
Oct 30 21:55:56.366710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.366410    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"
Oct 30 21:55:56.416326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.416221    4943 scope.go:122] "RemoveContainer" containerID="158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61"
Oct 30 21:55:56.416838 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:55:56.416803    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61\": container with ID starting with 158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61 not found: ID does not exist" containerID="158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61"
Oct 30 21:55:56.416997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.416851    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61"} err="failed to get container status \"158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61\": rpc error: code = NotFound desc = could not find container \"158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61\": container with ID starting with 158e3023c7f15ed6829d63c70878cd3e3a3236b210b88be4707424a611da8b61 not found: ID does not exist"
Oct 30 21:55:56.549440 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.549360    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"]
Oct 30 21:55:56.595694 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.595654    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b34958-775868bcb4-h6t6z"]
Oct 30 21:55:56.816158 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:56.816062    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:57.082627 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:57.074636    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:57.269939 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:57.269867    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:57.464678 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:57.464636    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:57.619421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:57.619391    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79ff8730-c6df-48ef-8d3e-1378b522a7dd" path="/var/lib/kubelet/pods/79ff8730-c6df-48ef-8d3e-1378b522a7dd/volumes"
Oct 30 21:55:57.840505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:57.840402    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:58.573916 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:58.573876    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:58.863905 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:58.863796    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:59.076846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:59.076807    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:55:59.544425 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:55:59.544389    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:00.425370 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:00.425337    4943 generic.go:356] "Generic (PLEG): container finished" podID="504172ff-ddd4-4772-8a1d-674ab6557357" containerID="c1caf948ec563fc3ef5e90cd583f0f505d54b28cf78149ad2bbe32d6172e39b2" exitCode=0
Oct 30 21:56:00.425771 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:00.425408    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" event={"ID":"504172ff-ddd4-4772-8a1d-674ab6557357","Type":"ContainerDied","Data":"c1caf948ec563fc3ef5e90cd583f0f505d54b28cf78149ad2bbe32d6172e39b2"}
Oct 30 21:56:00.425814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:00.425796    4943 scope.go:122] "RemoveContainer" containerID="c1caf948ec563fc3ef5e90cd583f0f505d54b28cf78149ad2bbe32d6172e39b2"
Oct 30 21:56:00.427415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:00.427389    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:56:00.427493 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:00.427459    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:56:00.427538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:00.427500    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 21:56:01.434407 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:01.434370    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" event={"ID":"504172ff-ddd4-4772-8a1d-674ab6557357","Type":"ContainerStarted","Data":"e72f22822a1f00b270ea076841d133806ca72e5332ba3b14e0a699f507cb643c"}
Oct 30 21:56:02.135798 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:02.135765    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:56:02.136026 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:02.135976    4943 patch_prober.go:29] interesting pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 21:56:02.136128 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:02.136040    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 21:56:02.929436 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:02.929385    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:03.136118 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:03.136086    4943 patch_prober.go:29] interesting pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 21:56:03.136280 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:03.136146    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 21:56:03.174971 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:03.174934    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:03.208282 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:03.208200    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"]
Oct 30 21:56:03.208754 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:03.208717    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy" containerID="cri-o://5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a" gracePeriod=30
Oct 30 21:56:03.376514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:03.376477    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:04.135719 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:04.135682    4943 patch_prober.go:29] interesting pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 21:56:04.136328 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:04.135751    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 21:56:04.193875 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:04.193843    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:05.136036 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:05.136000    4943 patch_prober.go:29] interesting pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 21:56:05.136523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:05.136088    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 21:56:05.293191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:05.293146    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:05.499732 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:05.495061    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:05.711574 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:05.704347    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:05.975013 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:05.974967    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:06.136348 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:06.136307    4943 patch_prober.go:29] interesting pod/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused" start-of-body=
Oct 30 21:56:06.136871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:06.136363    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.118:15021/healthz/ready\": dial tcp 10.132.0.118:15021: connect: connection refused"
Oct 30 21:56:07.140444 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:07.140417    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:56:07.140943 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:07.140924    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:56:07.141606 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:07.141586    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 21:56:08.215439 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.215395    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:08.532065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.532041    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:56:08.554343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.554316    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-podinfo\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.554511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.554361    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istiod-ca-cert\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.554511 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.554397    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-envoy\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.565862 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.565829    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-podinfo" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:56:08.566378 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.566353    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-envoy" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:08.566549 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.555169    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istiod-ca-cert" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:56:08.566837 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.566812    4943 generic.go:356] "Generic (PLEG): container finished" podID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerID="5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a" exitCode=0
Oct 30 21:56:08.567683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.566942    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"
Oct 30 21:56:08.567683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.567072    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" event={"ID":"af2d8b99-00c6-49f4-b48d-ed5fffb21809","Type":"ContainerDied","Data":"5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a"}
Oct 30 21:56:08.567683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.567173    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz" event={"ID":"af2d8b99-00c6-49f4-b48d-ed5fffb21809","Type":"ContainerDied","Data":"804acb3286dfb40639b915050597c86b2b3d0ebae0baf0a2b4f857a767420c14"}
Oct 30 21:56:08.567683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.567203    4943 scope.go:122] "RemoveContainer" containerID="5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a"
Oct 30 21:56:08.586482 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.586459    4943 scope.go:122] "RemoveContainer" containerID="56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b"
Oct 30 21:56:08.595861 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.595842    4943 scope.go:122] "RemoveContainer" containerID="5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a"
Oct 30 21:56:08.596137 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:08.596116    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a\": container with ID starting with 5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a not found: ID does not exist" containerID="5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a"
Oct 30 21:56:08.596210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.596152    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a"} err="failed to get container status \"5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a\": rpc error: code = NotFound desc = could not find container \"5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a\": container with ID starting with 5ef7edf614aba57ef358689e732603a55a6f34914f6116c92bddca8eeb8c408a not found: ID does not exist"
Oct 30 21:56:08.596210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.596176    4943 scope.go:122] "RemoveContainer" containerID="56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b"
Oct 30 21:56:08.596450 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:08.596434    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b\": container with ID starting with 56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b not found: ID does not exist" containerID="56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b"
Oct 30 21:56:08.596494 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.596458    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b"} err="failed to get container status \"56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b\": rpc error: code = NotFound desc = could not find container \"56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b\": container with ID starting with 56a4349e1bbeb7ff010b83c7fed32ce2298598bf5341c18b7db000e2c64d725b not found: ID does not exist"
Oct 30 21:56:08.655530 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655490    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-data\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.655530 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655527    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-certs\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.655748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655586    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-credential-socket\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.655748 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655677    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-kube-api-access-t6xzb\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-kube-api-access-t6xzb\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.655856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655748    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-socket\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.655856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655792    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-data" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:08.655856 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655803    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-token\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-token\") pod \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\" (UID: \"af2d8b99-00c6-49f4-b48d-ed5fffb21809\") "
Oct 30 21:56:08.656011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.655869    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-certs" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:08.656090 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.656067    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-socket" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:08.656269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.656245    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-credential-socket" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:08.657119 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.657096    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.657223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.657120    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.657223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.657136    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.657223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.657151    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.657223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.657164    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.657223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.657178    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.657223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.657192    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af2d8b99-00c6-49f4-b48d-ed5fffb21809-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.658405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.658380    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-kube-api-access-t6xzb" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "kube-api-access-t6xzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:08.658500 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.658462    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-token" pod "af2d8b99-00c6-49f4-b48d-ed5fffb21809" (UID: "af2d8b99-00c6-49f4-b48d-ed5fffb21809"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:08.758285 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.758148    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6xzb\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-kube-api-access-t6xzb\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.758285 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.758181    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2d8b99-00c6-49f4-b48d-ed5fffb21809-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:08.993046 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.993004    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"]
Oct 30 21:56:08.996224 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:08.996202    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-89c0fd-openshift-default-6877577c49-kqbrz"]
Oct 30 21:56:09.579372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:09.579258    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:09.620269 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:09.620230    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" path="/var/lib/kubelet/pods/af2d8b99-00c6-49f4-b48d-ed5fffb21809/volumes"
Oct 30 21:56:10.892696 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:10.892660    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"]
Oct 30 21:56:10.939867 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:10.939837    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"]
Oct 30 21:56:11.025452 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:11.025421    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:14.190316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:14.190270    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:14.384059 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:14.384022    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:14.807332 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:14.807277    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:18.207675 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:18.207634    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:18.672866 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:18.672830    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:19.023914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.023508    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"]
Oct 30 21:56:19.023914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.023796    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b" podUID="292ea458-d0ad-4357-b260-621f25104384" containerName="maas-api" containerID="cri-o://e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a" gracePeriod=30
Oct 30 21:56:19.178196 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.178158    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:19.388250 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.388159    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:19.520988 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.520659    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:56:19.660359 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.660324    4943 generic.go:356] "Generic (PLEG): container finished" podID="292ea458-d0ad-4357-b260-621f25104384" containerID="e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a" exitCode=0
Oct 30 21:56:19.660604 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.660523    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b" event={"ID":"292ea458-d0ad-4357-b260-621f25104384","Type":"ContainerDied","Data":"e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a"}
Oct 30 21:56:19.660710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.660621    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b" event={"ID":"292ea458-d0ad-4357-b260-621f25104384","Type":"ContainerDied","Data":"64ba3bd0ab2943d428f83c0f2176de173568ec8ff8110860417add1537a03de2"}
Oct 30 21:56:19.660710 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.660657    4943 scope.go:122] "RemoveContainer" containerID="e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a"
Oct 30 21:56:19.661300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.660505    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"
Oct 30 21:56:19.661300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.661220    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:19.675240 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.675224    4943 scope.go:122] "RemoveContainer" containerID="e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a"
Oct 30 21:56:19.675772 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:19.675749    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a\": container with ID starting with e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a not found: ID does not exist" containerID="e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a"
Oct 30 21:56:19.675938 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.675913    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a"} err="failed to get container status \"e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a\": rpc error: code = NotFound desc = could not find container \"e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a\": container with ID starting with e99ebf08a45f4bb60d0f91d61208f369d91d89d98d0a3b7d5771e132c737333a not found: ID does not exist"
Oct 30 21:56:19.679505 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.679481    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/292ea458-d0ad-4357-b260-621f25104384-kube-api-access-bsmpv\" (UniqueName: \"kubernetes.io/projected/292ea458-d0ad-4357-b260-621f25104384-kube-api-access-bsmpv\") pod \"292ea458-d0ad-4357-b260-621f25104384\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") "
Oct 30 21:56:19.679631 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.679538    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls\") pod \"292ea458-d0ad-4357-b260-621f25104384\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") "
Oct 30 21:56:19.679708 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.679686    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/292ea458-d0ad-4357-b260-621f25104384-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292ea458-d0ad-4357-b260-621f25104384-openshift-service-ca\") pod \"292ea458-d0ad-4357-b260-621f25104384\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") "
Oct 30 21:56:19.679765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.679738    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-metrics-certs\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-metrics-certs\") pod \"292ea458-d0ad-4357-b260-621f25104384\" (UID: \"292ea458-d0ad-4357-b260-621f25104384\") "
Oct 30 21:56:19.680398 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.680362    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292ea458-d0ad-4357-b260-621f25104384-openshift-service-ca" pod "292ea458-d0ad-4357-b260-621f25104384" (UID: "292ea458-d0ad-4357-b260-621f25104384"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:56:19.694801 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.693616    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-metrics-certs" pod "292ea458-d0ad-4357-b260-621f25104384" (UID: "292ea458-d0ad-4357-b260-621f25104384"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:19.694801 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.694590    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292ea458-d0ad-4357-b260-621f25104384-kube-api-access-bsmpv" pod "292ea458-d0ad-4357-b260-621f25104384" (UID: "292ea458-d0ad-4357-b260-621f25104384"). InnerVolumeSpecName "kube-api-access-bsmpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:19.694801 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.694707    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls" pod "292ea458-d0ad-4357-b260-621f25104384" (UID: "292ea458-d0ad-4357-b260-621f25104384"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:19.781953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.781913    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/292ea458-d0ad-4357-b260-621f25104384-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:19.781953 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.781951    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:19.782220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.781966    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsmpv\" (UniqueName: \"kubernetes.io/projected/292ea458-d0ad-4357-b260-621f25104384-kube-api-access-bsmpv\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:19.782220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:19.781981    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/292ea458-d0ad-4357-b260-621f25104384-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:20.098232 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:20.096747    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"]
Oct 30 21:56:20.102259 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:20.102229    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-1dc70e-55cc7d794-wc77b"]
Oct 30 21:56:20.742770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:20.742731    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:20.955841 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:20.955801    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:21.064638 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:21.064477    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:56:21.131698 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:21.128078    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:21.618588 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:21.618539    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="292ea458-d0ad-4357-b260-621f25104384" path="/var/lib/kubelet/pods/292ea458-d0ad-4357-b260-621f25104384/volumes"
Oct 30 21:56:24.546584 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:24.546530    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:25.913421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:25.913360    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main" containerID="cri-o://f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368" gracePeriod=45
Oct 30 21:56:25.959636 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:25.959578    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main" containerID="cri-o://4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db" gracePeriod=45
Oct 30 21:56:26.220643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.220617    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:56:26.253869 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.253843    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:56:26.268776 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.268751    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-home\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-home\") pod \"e5235049-e55c-40f7-bc8a-ca5d63b39946\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") "
Oct 30 21:56:26.268888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.268798    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-dshm\") pod \"e5235049-e55c-40f7-bc8a-ca5d63b39946\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") "
Oct 30 21:56:26.268888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.268869    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e5235049-e55c-40f7-bc8a-ca5d63b39946-kube-api-access-dgg5g\" (UniqueName: \"kubernetes.io/projected/e5235049-e55c-40f7-bc8a-ca5d63b39946-kube-api-access-dgg5g\") pod \"e5235049-e55c-40f7-bc8a-ca5d63b39946\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") "
Oct 30 21:56:26.268969 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.268949    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-home" pod "e5235049-e55c-40f7-bc8a-ca5d63b39946" (UID: "e5235049-e55c-40f7-bc8a-ca5d63b39946"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.268969 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.268958    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-tmp-dir\") pod \"e5235049-e55c-40f7-bc8a-ca5d63b39946\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") "
Oct 30 21:56:26.269046 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.268997    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e5235049-e55c-40f7-bc8a-ca5d63b39946-tls-certs\" (UniqueName: \"kubernetes.io/secret/e5235049-e55c-40f7-bc8a-ca5d63b39946-tls-certs\") pod \"e5235049-e55c-40f7-bc8a-ca5d63b39946\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") "
Oct 30 21:56:26.269081 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.269057    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-model-cache\") pod \"e5235049-e55c-40f7-bc8a-ca5d63b39946\" (UID: \"e5235049-e55c-40f7-bc8a-ca5d63b39946\") "
Oct 30 21:56:26.269282 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.269253    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-tmp-dir" pod "e5235049-e55c-40f7-bc8a-ca5d63b39946" (UID: "e5235049-e55c-40f7-bc8a-ca5d63b39946"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.269389 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.269370    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-model-cache" pod "e5235049-e55c-40f7-bc8a-ca5d63b39946" (UID: "e5235049-e55c-40f7-bc8a-ca5d63b39946"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.269608 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.269592    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.269672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.269615    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.269672 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.269630    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.271241 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.271212    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5235049-e55c-40f7-bc8a-ca5d63b39946-tls-certs" pod "e5235049-e55c-40f7-bc8a-ca5d63b39946" (UID: "e5235049-e55c-40f7-bc8a-ca5d63b39946"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:26.271455 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.271436    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-dshm" pod "e5235049-e55c-40f7-bc8a-ca5d63b39946" (UID: "e5235049-e55c-40f7-bc8a-ca5d63b39946"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.271520 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.271450    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5235049-e55c-40f7-bc8a-ca5d63b39946-kube-api-access-dgg5g" pod "e5235049-e55c-40f7-bc8a-ca5d63b39946" (UID: "e5235049-e55c-40f7-bc8a-ca5d63b39946"). InnerVolumeSpecName "kube-api-access-dgg5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:26.316577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.316476    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:26.370014 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.369978    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/74616002-631e-4d11-b33a-d970a68724f9-kube-api-access-j9lm4\" (UniqueName: \"kubernetes.io/projected/74616002-631e-4d11-b33a-d970a68724f9-kube-api-access-j9lm4\") pod \"74616002-631e-4d11-b33a-d970a68724f9\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") "
Oct 30 21:56:26.370189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370047    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-dshm\") pod \"74616002-631e-4d11-b33a-d970a68724f9\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") "
Oct 30 21:56:26.370189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370127    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-model-cache\") pod \"74616002-631e-4d11-b33a-d970a68724f9\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") "
Oct 30 21:56:26.370189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370158    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/74616002-631e-4d11-b33a-d970a68724f9-tls-certs\" (UniqueName: \"kubernetes.io/secret/74616002-631e-4d11-b33a-d970a68724f9-tls-certs\") pod \"74616002-631e-4d11-b33a-d970a68724f9\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") "
Oct 30 21:56:26.370380 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370315    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-tmp-dir\") pod \"74616002-631e-4d11-b33a-d970a68724f9\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") "
Oct 30 21:56:26.370512 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370434    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-home\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-home\") pod \"74616002-631e-4d11-b33a-d970a68724f9\" (UID: \"74616002-631e-4d11-b33a-d970a68724f9\") "
Oct 30 21:56:26.370935 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370808    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-tmp-dir" pod "74616002-631e-4d11-b33a-d970a68724f9" (UID: "74616002-631e-4d11-b33a-d970a68724f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.371051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370937    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5235049-e55c-40f7-bc8a-ca5d63b39946-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.371051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370958    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.371051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370972    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5235049-e55c-40f7-bc8a-ca5d63b39946-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.371051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370979    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-home" pod "74616002-631e-4d11-b33a-d970a68724f9" (UID: "74616002-631e-4d11-b33a-d970a68724f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.371051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.370986    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgg5g\" (UniqueName: \"kubernetes.io/projected/e5235049-e55c-40f7-bc8a-ca5d63b39946-kube-api-access-dgg5g\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.371051 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.371041    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-model-cache" pod "74616002-631e-4d11-b33a-d970a68724f9" (UID: "74616002-631e-4d11-b33a-d970a68724f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.373185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.373153    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-dshm" pod "74616002-631e-4d11-b33a-d970a68724f9" (UID: "74616002-631e-4d11-b33a-d970a68724f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:26.373687 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.373635    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74616002-631e-4d11-b33a-d970a68724f9-tls-certs" pod "74616002-631e-4d11-b33a-d970a68724f9" (UID: "74616002-631e-4d11-b33a-d970a68724f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:26.381365 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.381341    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74616002-631e-4d11-b33a-d970a68724f9-kube-api-access-j9lm4" pod "74616002-631e-4d11-b33a-d970a68724f9" (UID: "74616002-631e-4d11-b33a-d970a68724f9"). InnerVolumeSpecName "kube-api-access-j9lm4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:26.473007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.472926    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.473007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.472961    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9lm4\" (UniqueName: \"kubernetes.io/projected/74616002-631e-4d11-b33a-d970a68724f9-kube-api-access-j9lm4\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.473007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.472975    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.473007 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.472997    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/74616002-631e-4d11-b33a-d970a68724f9-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.473344 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.473011    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74616002-631e-4d11-b33a-d970a68724f9-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:26.716782 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.716708    4943 generic.go:356] "Generic (PLEG): container finished" podID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerID="f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368" exitCode=0
Oct 30 21:56:26.716782 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.716764    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"
Oct 30 21:56:26.716992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.716788    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" event={"ID":"e5235049-e55c-40f7-bc8a-ca5d63b39946","Type":"ContainerDied","Data":"f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368"}
Oct 30 21:56:26.716992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.716831    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf" event={"ID":"e5235049-e55c-40f7-bc8a-ca5d63b39946","Type":"ContainerDied","Data":"f155896275986a4267972c9d0ada0ccb4e9575006db6985f46e5f64387fe6e94"}
Oct 30 21:56:26.716992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.716849    4943 scope.go:122] "RemoveContainer" containerID="f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368"
Oct 30 21:56:26.718366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.718339    4943 generic.go:356] "Generic (PLEG): container finished" podID="74616002-631e-4d11-b33a-d970a68724f9" containerID="4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db" exitCode=0
Oct 30 21:56:26.718486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.718388    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" event={"ID":"74616002-631e-4d11-b33a-d970a68724f9","Type":"ContainerDied","Data":"4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db"}
Oct 30 21:56:26.718486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.718403    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"
Oct 30 21:56:26.718486 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.718414    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v" event={"ID":"74616002-631e-4d11-b33a-d970a68724f9","Type":"ContainerDied","Data":"1d2e71e57a9b7206e557240b2ccb4179c87a6a1488566231288f8e3d16df223e"}
Oct 30 21:56:26.728013 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.727995    4943 scope.go:122] "RemoveContainer" containerID="f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368"
Oct 30 21:56:26.728310 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:26.728292    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368\": container with ID starting with f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368 not found: ID does not exist" containerID="f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368"
Oct 30 21:56:26.728372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.728320    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368"} err="failed to get container status \"f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368\": rpc error: code = NotFound desc = could not find container \"f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368\": container with ID starting with f1db65477eeafff19ba30b860699790cc3d9ccf7eaeef299a8d180283a5b5368 not found: ID does not exist"
Oct 30 21:56:26.728372 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.728344    4943 scope.go:122] "RemoveContainer" containerID="4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db"
Oct 30 21:56:26.737139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.737122    4943 scope.go:122] "RemoveContainer" containerID="4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db"
Oct 30 21:56:26.737393 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:26.737372    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db\": container with ID starting with 4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db not found: ID does not exist" containerID="4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db"
Oct 30 21:56:26.737453 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.737400    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db"} err="failed to get container status \"4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db\": rpc error: code = NotFound desc = could not find container \"4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db\": container with ID starting with 4d83caac2cf49cac7d5f217b2aec95552ea079f6d5718fd658475a12a74e43db not found: ID does not exist"
Oct 30 21:56:26.880065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.880034    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"]
Oct 30 21:56:26.882918 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.882894    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/simulator-w1-e4dadd-kserve-6ccc8d5cd-lbp9v"]
Oct 30 21:56:26.990699 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.990629    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"]
Oct 30 21:56:26.995617 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:26.995591    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-e4dadd/distinct-2-w1-e4dadd-kserve-7649cb5d9-l69qf"]
Oct 30 21:56:27.619204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:27.619171    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="74616002-631e-4d11-b33a-d970a68724f9" path="/var/lib/kubelet/pods/74616002-631e-4d11-b33a-d970a68724f9/volumes"
Oct 30 21:56:27.619618 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:27.619604    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" path="/var/lib/kubelet/pods/e5235049-e55c-40f7-bc8a-ca5d63b39946/volumes"
Oct 30 21:56:28.162199 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:28.162165    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:28.380629 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:28.380595    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:31.402136 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:31.402097    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:31.658580 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:31.658474    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:33.852938 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:33.852886    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:34.043747 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:34.043703    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:34.217477 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:34.217431    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:36.381770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:36.381737    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:37.414760 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:37.414729    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:37.597042 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:37.596995    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:37.791305 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:37.791209    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:37.974191 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:37.974157    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:38.335097 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:38.335060    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:39.513768 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:39.513735    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:39.688178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:39.688142    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:41.718996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:41.718960    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:43.247147 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:43.247108    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"]
Oct 30 21:56:43.298483 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:43.298446    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"]
Oct 30 21:56:43.398996 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:43.398956    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:46.065774 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:46.065747    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:56:46.069448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:46.069422    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 21:56:46.920011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:46.919969    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:47.159736 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:47.159700    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:47.357655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:47.353198    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:48.450577 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:48.450140    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:48.747771 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:48.747676    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:48.931928 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:48.931894    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:49.123306 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:49.123226    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:49.727612 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:49.727575    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:50.915788 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:50.915664    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:51.062902 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:51.062873    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:56:51.110701 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:51.109049    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:51.669532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:51.669486    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:53.391890 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:53.391850    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:53.664366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:53.664331    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:53.846123 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:53.846079    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:54.324003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:54.323968    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:55.077931 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:55.077894    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:55.257569 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:55.257520    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:57.763867 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:57.763817    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:57.996825 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:57.996780    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"]
Oct 30 21:56:57.997017 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:57.996986    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm" podUID="953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" containerName="maas-api" containerID="cri-o://255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88" gracePeriod=30
Oct 30 21:56:58.137366 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.137322    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:56:58.354635 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.334844    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" containerID="cri-o://a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe" gracePeriod=45
Oct 30 21:56:58.355043 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.340016    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" containerID="cri-o://022fb79b8743b94cd489daf718e592131026ba607593a4d3e20cd31ccfe29093" gracePeriod=45
Oct 30 21:56:58.525765 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.525721    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main" probeResult="failure" output="Get \"https://10.132.0.67:8000/ready\": EOF"
Oct 30 21:56:58.537044 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.534806    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:56:58.627683 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.627602    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-kube-api-access-pz68j\" (UniqueName: \"kubernetes.io/projected/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-kube-api-access-pz68j\") pod \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") "
Oct 30 21:56:58.627846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.627736    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-metrics-certs\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-metrics-certs\") pod \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") "
Oct 30 21:56:58.627846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.627769    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-maas-api-tls\") pod \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") "
Oct 30 21:56:58.627846 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.627839    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-openshift-service-ca\") pod \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\" (UID: \"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f\") "
Oct 30 21:56:58.628526 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.628498    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-openshift-service-ca" pod "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" (UID: "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:56:58.632605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.630035    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-kube-api-access-pz68j" pod "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" (UID: "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f"). InnerVolumeSpecName "kube-api-access-pz68j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:58.632605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.630113    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-maas-api-tls" pod "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" (UID: "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:58.632605 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.630260    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-metrics-certs" pod "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" (UID: "953ba15a-d86e-4b7b-88c2-d2d0b7f3896f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:58.732597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.730135    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.732597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.730175    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.732597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.730194    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.732597 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.730207    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz68j\" (UniqueName: \"kubernetes.io/projected/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f-kube-api-access-pz68j\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.749009 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.748978    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:56:58.831473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.831436    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-tmp-dir\") pod \"10c39742-4da4-468e-88d3-c08cb408d623\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") "
Oct 30 21:56:58.831983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.831513    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-dshm\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-dshm\") pod \"10c39742-4da4-468e-88d3-c08cb408d623\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") "
Oct 30 21:56:58.831983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.831589    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/10c39742-4da4-468e-88d3-c08cb408d623-tls-certs\" (UniqueName: \"kubernetes.io/secret/10c39742-4da4-468e-88d3-c08cb408d623-tls-certs\") pod \"10c39742-4da4-468e-88d3-c08cb408d623\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") "
Oct 30 21:56:58.831983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.831645    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10c39742-4da4-468e-88d3-c08cb408d623-kube-api-access-6m9mx\" (UniqueName: \"kubernetes.io/projected/10c39742-4da4-468e-88d3-c08cb408d623-kube-api-access-6m9mx\") pod \"10c39742-4da4-468e-88d3-c08cb408d623\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") "
Oct 30 21:56:58.831983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.831775    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-model-cache\") pod \"10c39742-4da4-468e-88d3-c08cb408d623\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") "
Oct 30 21:56:58.831983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.831803    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-home\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-home\") pod \"10c39742-4da4-468e-88d3-c08cb408d623\" (UID: \"10c39742-4da4-468e-88d3-c08cb408d623\") "
Oct 30 21:56:58.831983 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.831888    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-tmp-dir" pod "10c39742-4da4-468e-88d3-c08cb408d623" (UID: "10c39742-4da4-468e-88d3-c08cb408d623"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:58.832337 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.832076    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-model-cache" pod "10c39742-4da4-468e-88d3-c08cb408d623" (UID: "10c39742-4da4-468e-88d3-c08cb408d623"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:58.832337 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.832307    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-home" pod "10c39742-4da4-468e-88d3-c08cb408d623" (UID: "10c39742-4da4-468e-88d3-c08cb408d623"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:58.832446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.832347    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.832446 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.832376    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.834299 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.834267    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c39742-4da4-468e-88d3-c08cb408d623-kube-api-access-6m9mx" pod "10c39742-4da4-468e-88d3-c08cb408d623" (UID: "10c39742-4da4-468e-88d3-c08cb408d623"). InnerVolumeSpecName "kube-api-access-6m9mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:58.834399 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.834300    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-dshm" pod "10c39742-4da4-468e-88d3-c08cb408d623" (UID: "10c39742-4da4-468e-88d3-c08cb408d623"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:58.834399 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.834353    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c39742-4da4-468e-88d3-c08cb408d623-tls-certs" pod "10c39742-4da4-468e-88d3-c08cb408d623" (UID: "10c39742-4da4-468e-88d3-c08cb408d623"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:58.934233 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.934193    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.934233 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.934235    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10c39742-4da4-468e-88d3-c08cb408d623-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.934508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.934249    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10c39742-4da4-468e-88d3-c08cb408d623-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:58.934508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:58.934266    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m9mx\" (UniqueName: \"kubernetes.io/projected/10c39742-4da4-468e-88d3-c08cb408d623-kube-api-access-6m9mx\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:59.209071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.208845    4943 generic.go:356] "Generic (PLEG): container finished" podID="459030a0-1766-4829-acb1-d845be102439" containerID="022fb79b8743b94cd489daf718e592131026ba607593a4d3e20cd31ccfe29093" exitCode=0
Oct 30 21:56:59.209071 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.208951    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" event={"ID":"459030a0-1766-4829-acb1-d845be102439","Type":"ContainerDied","Data":"022fb79b8743b94cd489daf718e592131026ba607593a4d3e20cd31ccfe29093"}
Oct 30 21:56:59.223709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.212438    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main" probeResult="failure" output="Get \"https://10.132.0.76:8000/ready\": dial tcp 10.132.0.76:8000: connect: connection refused"
Oct 30 21:56:59.223709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.212961    4943 generic.go:356] "Generic (PLEG): container finished" podID="953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" containerID="255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88" exitCode=0
Oct 30 21:56:59.223709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.213073    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm" event={"ID":"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f","Type":"ContainerDied","Data":"255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88"}
Oct 30 21:56:59.223709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.213161    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm" event={"ID":"953ba15a-d86e-4b7b-88c2-d2d0b7f3896f","Type":"ContainerDied","Data":"b9725351043a3979cf8cc42e56fadbfe98abcebbe3be55833b646fad7e741ca8"}
Oct 30 21:56:59.223709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.213192    4943 scope.go:122] "RemoveContainer" containerID="255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88"
Oct 30 21:56:59.223709 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.221626    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"
Oct 30 21:56:59.239148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.234596    4943 generic.go:356] "Generic (PLEG): container finished" podID="10c39742-4da4-468e-88d3-c08cb408d623" containerID="a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe" exitCode=0
Oct 30 21:56:59.239148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.234718    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" event={"ID":"10c39742-4da4-468e-88d3-c08cb408d623","Type":"ContainerDied","Data":"a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe"}
Oct 30 21:56:59.239148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.234753    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2" event={"ID":"10c39742-4da4-468e-88d3-c08cb408d623","Type":"ContainerDied","Data":"25f1078756ba847e0dab8fb6259d7495270eb258761f088159347ab228bc8562"}
Oct 30 21:56:59.239148 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.234824    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"
Oct 30 21:56:59.265914 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.265889    4943 scope.go:122] "RemoveContainer" containerID="255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88"
Oct 30 21:56:59.266336 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:59.266310    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88\": container with ID starting with 255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88 not found: ID does not exist" containerID="255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88"
Oct 30 21:56:59.266422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.266348    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88"} err="failed to get container status \"255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88\": rpc error: code = NotFound desc = could not find container \"255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88\": container with ID starting with 255a9b1e782fc22dba88aac9da986d577ede2b6cad38e141d54c45da25c92f88 not found: ID does not exist"
Oct 30 21:56:59.266422 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.266373    4943 scope.go:122] "RemoveContainer" containerID="a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe"
Oct 30 21:56:59.284087 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.284066    4943 scope.go:122] "RemoveContainer" containerID="a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe"
Oct 30 21:56:59.284508 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:56:59.284448    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe\": container with ID starting with a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe not found: ID does not exist" containerID="a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe"
Oct 30 21:56:59.284508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.284479    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe"} err="failed to get container status \"a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe\": rpc error: code = NotFound desc = could not find container \"a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe\": container with ID starting with a1ece60420959b5e821826ba2801f210377b9d3b70ad9e0dadcdf62efc8fefbe not found: ID does not exist"
Oct 30 21:56:59.382053 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.382025    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:56:59.392538 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.392511    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"]
Oct 30 21:56:59.401763 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.401733    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-021907/premium-w5-021907-kserve-5b54c47654-c56n2"]
Oct 30 21:56:59.456243 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456208    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-home\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-home\") pod \"459030a0-1766-4829-acb1-d845be102439\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") "
Oct 30 21:56:59.456437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456286    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/459030a0-1766-4829-acb1-d845be102439-tls-certs\" (UniqueName: \"kubernetes.io/secret/459030a0-1766-4829-acb1-d845be102439-tls-certs\") pod \"459030a0-1766-4829-acb1-d845be102439\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") "
Oct 30 21:56:59.456437 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456371    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/459030a0-1766-4829-acb1-d845be102439-kube-api-access-mtslr\" (UniqueName: \"kubernetes.io/projected/459030a0-1766-4829-acb1-d845be102439-kube-api-access-mtslr\") pod \"459030a0-1766-4829-acb1-d845be102439\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") "
Oct 30 21:56:59.456585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456442    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-tmp-dir\") pod \"459030a0-1766-4829-acb1-d845be102439\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") "
Oct 30 21:56:59.456585 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456483    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-home" pod "459030a0-1766-4829-acb1-d845be102439" (UID: "459030a0-1766-4829-acb1-d845be102439"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:59.456750 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456723    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-tmp-dir" pod "459030a0-1766-4829-acb1-d845be102439" (UID: "459030a0-1766-4829-acb1-d845be102439"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:59.456908 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456888    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:59.456977 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.456909    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:59.458506 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.458483    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/459030a0-1766-4829-acb1-d845be102439-tls-certs" pod "459030a0-1766-4829-acb1-d845be102439" (UID: "459030a0-1766-4829-acb1-d845be102439"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:56:59.458635 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.458518    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/459030a0-1766-4829-acb1-d845be102439-kube-api-access-mtslr" pod "459030a0-1766-4829-acb1-d845be102439" (UID: "459030a0-1766-4829-acb1-d845be102439"). InnerVolumeSpecName "kube-api-access-mtslr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:56:59.509689 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.509656    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"]
Oct 30 21:56:59.513405 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.513378    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6b42c9-5d879bc9b8-997cm"]
Oct 30 21:56:59.557598 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.557564    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-dshm\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-dshm\") pod \"459030a0-1766-4829-acb1-d845be102439\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") "
Oct 30 21:56:59.557753 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.557641    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-model-cache\") pod \"459030a0-1766-4829-acb1-d845be102439\" (UID: \"459030a0-1766-4829-acb1-d845be102439\") "
Oct 30 21:56:59.557909 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.557887    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-model-cache" pod "459030a0-1766-4829-acb1-d845be102439" (UID: "459030a0-1766-4829-acb1-d845be102439"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:59.557987 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.557891    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtslr\" (UniqueName: \"kubernetes.io/projected/459030a0-1766-4829-acb1-d845be102439-kube-api-access-mtslr\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:59.557987 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.557941    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/459030a0-1766-4829-acb1-d845be102439-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:59.561380 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.561351    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-dshm" pod "459030a0-1766-4829-acb1-d845be102439" (UID: "459030a0-1766-4829-acb1-d845be102439"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:56:59.637355 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.637319    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10c39742-4da4-468e-88d3-c08cb408d623" path="/var/lib/kubelet/pods/10c39742-4da4-468e-88d3-c08cb408d623/volumes"
Oct 30 21:56:59.642341 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.637985    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" path="/var/lib/kubelet/pods/953ba15a-d86e-4b7b-88c2-d2d0b7f3896f/volumes"
Oct 30 21:56:59.661829 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.660656    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:59.661829 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.660688    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/459030a0-1766-4829-acb1-d845be102439-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:56:59.942674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:56:59.942632    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:00.212828 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.212734    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:00.254648 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.254602    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw" event={"ID":"459030a0-1766-4829-acb1-d845be102439","Type":"ContainerDied","Data":"90752aaabaa2b7d5c63f8e3be6fdc64cdd642522350634dbcdb5ce2b90dffb6e"}
Oct 30 21:57:00.254920 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.254901    4943 scope.go:122] "RemoveContainer" containerID="022fb79b8743b94cd489daf718e592131026ba607593a4d3e20cd31ccfe29093"
Oct 30 21:57:00.255070 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.254674    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"
Oct 30 21:57:00.396734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.396702    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:00.420531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.420496    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"]
Oct 30 21:57:00.423370 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.423346    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-021907/distinct-2-w5-021907-kserve-68d5c5dcf4-wl4nw"]
Oct 30 21:57:00.660301 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.660266    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:00.845210 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:00.845170    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:01.058288 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:01.058151    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:01.620530 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:01.620497    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="459030a0-1766-4829-acb1-d845be102439" path="/var/lib/kubelet/pods/459030a0-1766-4829-acb1-d845be102439/volumes"
Oct 30 21:57:04.155185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:04.155138    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:05.789163 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:05.789132    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:08.896576 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:08.896280    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:09.073758 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:09.073704    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:10.058341 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:10.058288    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:10.874975 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:10.874934    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:11.049451 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:11.049416    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:12.309778 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:12.309356    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:15.411016 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:15.410982    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:15.616899 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:15.616863    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:16.079113 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:16.079077    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:16.530356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:16.530321    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:17.163803 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:17.163770    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:17.347134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:17.347103    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:17.464960 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:17.464880    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"]
Oct 30 21:57:17.465127 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:17.465103    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy" containerID="cri-o://ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac" gracePeriod=30
Oct 30 21:57:17.559204 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:17.559103    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:21.039264 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:21.039217    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:21.085036 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:57:21.084996    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:57:21.221985 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:21.221948    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:21.413393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:21.413350    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:22.718735 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.718713    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:57:22.852074 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.851997    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06706923-8325-472a-9fb8-05f5ff6e0dab-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06706923-8325-472a-9fb8-05f5ff6e0dab-istiod-ca-cert\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852079    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-data\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852130    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-envoy\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852220 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852166    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-podinfo\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852356    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-data" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:22.852381 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852372    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06706923-8325-472a-9fb8-05f5ff6e0dab-istiod-ca-cert" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:22.852490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852357    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-credential-socket\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852490 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852457    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-socket\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852541    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-kube-api-access-2cd9h\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-kube-api-access-2cd9h\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852588    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-credential-socket" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:22.852623 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852596    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-certs\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852787 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852668    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-token\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-token\") pod \"06706923-8325-472a-9fb8-05f5ff6e0dab\" (UID: \"06706923-8325-472a-9fb8-05f5ff6e0dab\") "
Oct 30 21:57:22.852852 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852786    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-certs" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:22.852852 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.852801    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-socket" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:22.853223 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.853197    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.853326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.853230    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.853326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.853246    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.853326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.853260    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.853326 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.853274    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06706923-8325-472a-9fb8-05f5ff6e0dab-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.854674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.854650    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-envoy" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:22.854810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.854779    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-podinfo" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:57:22.854919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.854894    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-kube-api-access-2cd9h" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "kube-api-access-2cd9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:22.854970 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.854933    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-token" pod "06706923-8325-472a-9fb8-05f5ff6e0dab" (UID: "06706923-8325-472a-9fb8-05f5ff6e0dab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:22.954318 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.954280    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.954318 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.954313    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.954514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.954328    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cd9h\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-kube-api-access-2cd9h\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:22.954514 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:22.954342    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06706923-8325-472a-9fb8-05f5ff6e0dab-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:23.434321 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.434286    4943 generic.go:356] "Generic (PLEG): container finished" podID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerID="ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac" exitCode=0
Oct 30 21:57:23.434523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.434343    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"
Oct 30 21:57:23.434523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.434368    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" event={"ID":"06706923-8325-472a-9fb8-05f5ff6e0dab","Type":"ContainerDied","Data":"ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac"}
Oct 30 21:57:23.434523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.434431    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt" event={"ID":"06706923-8325-472a-9fb8-05f5ff6e0dab","Type":"ContainerDied","Data":"28b3fd45dd3b37f476957236f4db55d3f57a190a9c226679df67a46f9463756a"}
Oct 30 21:57:23.434523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.434462    4943 scope.go:122] "RemoveContainer" containerID="ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac"
Oct 30 21:57:23.445126 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.445106    4943 scope.go:122] "RemoveContainer" containerID="709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3"
Oct 30 21:57:23.453998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.453974    4943 scope.go:122] "RemoveContainer" containerID="ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac"
Oct 30 21:57:23.454291 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:57:23.454267    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac\": container with ID starting with ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac not found: ID does not exist" containerID="ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac"
Oct 30 21:57:23.454347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.454306    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac"} err="failed to get container status \"ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac\": rpc error: code = NotFound desc = could not find container \"ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac\": container with ID starting with ee303f53cfe177c991f1178a90224c1c7898ab5cb172540be1c4389b0206e2ac not found: ID does not exist"
Oct 30 21:57:23.454347 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.454330    4943 scope.go:122] "RemoveContainer" containerID="709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3"
Oct 30 21:57:23.454607 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:57:23.454586    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3\": container with ID starting with 709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3 not found: ID does not exist" containerID="709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3"
Oct 30 21:57:23.454688 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.454616    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3"} err="failed to get container status \"709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3\": rpc error: code = NotFound desc = could not find container \"709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3\": container with ID starting with 709d0522ac0769b66981d02e40910ae5302b75d5b490561735433f38306470d3 not found: ID does not exist"
Oct 30 21:57:23.599376 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.599343    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"]
Oct 30 21:57:23.648477 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:23.648443    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-6b42c9-openshift-default-89bbb7987-lndnt"]
Oct 30 21:57:25.618409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:25.618374    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" path="/var/lib/kubelet/pods/06706923-8325-472a-9fb8-05f5ff6e0dab/volumes"
Oct 30 21:57:26.304899 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:26.304861    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:30.287634 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:30.281614    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:30.617687 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:30.617602    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:31.686720 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:31.686682    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:32.201160 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:32.201105    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:36.433203 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:36.433166    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:36.606868 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:36.606833    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:38.228523 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:38.228480    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:38.408992 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:38.408962    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:40.425178 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.425142    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"]
Oct 30 21:57:40.425728 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.425344    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw" podUID="2cf69444-5ab3-4471-8eaf-5479d9b852d8" containerName="maas-api" containerID="cri-o://a3e21a49d96d4aff1da6612119cad2a70464ef8b02c404a166c95712a5c3095e" gracePeriod=30
Oct 30 21:57:40.548532 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.548505    4943 generic.go:356] "Generic (PLEG): container finished" podID="2cf69444-5ab3-4471-8eaf-5479d9b852d8" containerID="a3e21a49d96d4aff1da6612119cad2a70464ef8b02c404a166c95712a5c3095e" exitCode=0
Oct 30 21:57:40.548674 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.548587    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw" event={"ID":"2cf69444-5ab3-4471-8eaf-5479d9b852d8","Type":"ContainerDied","Data":"a3e21a49d96d4aff1da6612119cad2a70464ef8b02c404a166c95712a5c3095e"}
Oct 30 21:57:40.571966 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.571917    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:40.730937 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.730912    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:57:40.879010 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.878978    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls\") pod \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") "
Oct 30 21:57:40.879185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.879033    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-metrics-certs\") pod \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") "
Oct 30 21:57:40.879185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.879122    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2cf69444-5ab3-4471-8eaf-5479d9b852d8-kube-api-access-v4l54\" (UniqueName: \"kubernetes.io/projected/2cf69444-5ab3-4471-8eaf-5479d9b852d8-kube-api-access-v4l54\") pod \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") "
Oct 30 21:57:40.879318 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.879241    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2cf69444-5ab3-4471-8eaf-5479d9b852d8-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf69444-5ab3-4471-8eaf-5479d9b852d8-openshift-service-ca\") pod \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\" (UID: \"2cf69444-5ab3-4471-8eaf-5479d9b852d8\") "
Oct 30 21:57:40.879658 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.879624    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cf69444-5ab3-4471-8eaf-5479d9b852d8-openshift-service-ca" pod "2cf69444-5ab3-4471-8eaf-5479d9b852d8" (UID: "2cf69444-5ab3-4471-8eaf-5479d9b852d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:40.879815 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.879754    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cf69444-5ab3-4471-8eaf-5479d9b852d8-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:40.881938 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.881910    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf69444-5ab3-4471-8eaf-5479d9b852d8-kube-api-access-v4l54" pod "2cf69444-5ab3-4471-8eaf-5479d9b852d8" (UID: "2cf69444-5ab3-4471-8eaf-5479d9b852d8"). InnerVolumeSpecName "kube-api-access-v4l54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:40.882158 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.882136    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-metrics-certs" pod "2cf69444-5ab3-4471-8eaf-5479d9b852d8" (UID: "2cf69444-5ab3-4471-8eaf-5479d9b852d8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:57:40.882352 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.882328    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls" pod "2cf69444-5ab3-4471-8eaf-5479d9b852d8" (UID: "2cf69444-5ab3-4471-8eaf-5479d9b852d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:57:40.981184 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.981116    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:40.981184 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.981141    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cf69444-5ab3-4471-8eaf-5479d9b852d8-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:40.981184 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:40.981152    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4l54\" (UniqueName: \"kubernetes.io/projected/2cf69444-5ab3-4471-8eaf-5479d9b852d8-kube-api-access-v4l54\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:41.557358 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:41.557323    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"
Oct 30 21:57:41.557358 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:41.557344    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw" event={"ID":"2cf69444-5ab3-4471-8eaf-5479d9b852d8","Type":"ContainerDied","Data":"a953794910cb5da97c55b971feea87f7a5bdf265718b386875ad5f22bcc5f790"}
Oct 30 21:57:41.557893 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:41.557410    4943 scope.go:122] "RemoveContainer" containerID="a3e21a49d96d4aff1da6612119cad2a70464ef8b02c404a166c95712a5c3095e"
Oct 30 21:57:41.723440 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:41.723410    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"]
Oct 30 21:57:41.729843 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:41.729815    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-021907-cc8d7988f-q6bfw"]
Oct 30 21:57:41.771727 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:41.771682    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:42.138998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:42.138963    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:42.422676 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:42.422642    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:43.076510 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:43.076468    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:43.410176 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:43.410143    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:43.617906 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:43.617874    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2cf69444-5ab3-4471-8eaf-5479d9b852d8" path="/var/lib/kubelet/pods/2cf69444-5ab3-4471-8eaf-5479d9b852d8/volumes"
Oct 30 21:57:43.688655 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:43.688577    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:43.869785 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:43.869750    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:44.385999 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:44.385931    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:48.365139 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:48.365099    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:49.125473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:49.125432    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:49.421016 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:49.420984    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:49.470025 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:49.469978    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"]
Oct 30 21:57:49.470258 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:49.470235    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy" containerID="cri-o://5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d" gracePeriod=30
Oct 30 21:57:49.605859 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:49.605826    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:50.008810 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:50.008776    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:50.201864 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:50.201835    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:50.385329 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:50.385243    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:50.899784 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:50.899746    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:51.064973 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:57:51.064930    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:57:51.080923 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:51.080896    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:54.725630 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.725604    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:57:54.729398 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.729369    4943 generic.go:356] "Generic (PLEG): container finished" podID="f4199b30-045a-4531-98cc-98a260d9dd70" containerID="5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d" exitCode=0
Oct 30 21:57:54.729531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.729411    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"
Oct 30 21:57:54.729531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.729445    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" event={"ID":"f4199b30-045a-4531-98cc-98a260d9dd70","Type":"ContainerDied","Data":"5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d"}
Oct 30 21:57:54.729531 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.729520    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw" event={"ID":"f4199b30-045a-4531-98cc-98a260d9dd70","Type":"ContainerDied","Data":"68e69a0dc88cb91a129b74760797907b8cf9518f1b738f62440e71dbfc995875"}
Oct 30 21:57:54.729692 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.729542    4943 scope.go:122] "RemoveContainer" containerID="5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d"
Oct 30 21:57:54.739324 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.739302    4943 scope.go:122] "RemoveContainer" containerID="5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d"
Oct 30 21:57:54.739639 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:57:54.739619    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d\": container with ID starting with 5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d not found: ID does not exist" containerID="5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d"
Oct 30 21:57:54.739706 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.739651    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d"} err="failed to get container status \"5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d\": rpc error: code = NotFound desc = could not find container \"5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d\": container with ID starting with 5a478d4cdc89bcee2c9d019d7efba01622e5131aa083e7efc93f39dcb0f2867d not found: ID does not exist"
Oct 30 21:57:54.767320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767291    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-socket\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767387    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f4199b30-045a-4531-98cc-98a260d9dd70-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4199b30-045a-4531-98cc-98a260d9dd70-istiod-ca-cert\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767475 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767439    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-data\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767500    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-kube-api-access-jnm6b\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-kube-api-access-jnm6b\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767536    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-istio-token\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-istio-token\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767564    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-socket" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:54.767643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767590    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-envoy\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767679    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-certs\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767718    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-credential-socket\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767769    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f4199b30-045a-4531-98cc-98a260d9dd70-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4199b30-045a-4531-98cc-98a260d9dd70-istio-podinfo\") pod \"f4199b30-045a-4531-98cc-98a260d9dd70\" (UID: \"f4199b30-045a-4531-98cc-98a260d9dd70\") "
Oct 30 21:57:54.767857 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767817    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-data" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:54.768069 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767996    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-certs" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:54.768182 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.767862    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4199b30-045a-4531-98cc-98a260d9dd70-istiod-ca-cert" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:57:54.768427 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.768393    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-credential-socket" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:54.768517 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.768486    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.768517 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.768511    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.768650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.768525    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4199b30-045a-4531-98cc-98a260d9dd70-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.768650 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.768541    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.770066 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.770036    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-envoy" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:57:54.770303 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.770276    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-kube-api-access-jnm6b" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "kube-api-access-jnm6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:54.770303 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.770300    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-istio-token" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:57:54.770432 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.770340    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4199b30-045a-4531-98cc-98a260d9dd70-istio-podinfo" pod "f4199b30-045a-4531-98cc-98a260d9dd70" (UID: "f4199b30-045a-4531-98cc-98a260d9dd70"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:57:54.870207 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.870176    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnm6b\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-kube-api-access-jnm6b\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.870207 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.870204    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4199b30-045a-4531-98cc-98a260d9dd70-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.870409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.870218    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.870409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.870231    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4199b30-045a-4531-98cc-98a260d9dd70-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:54.870409 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:54.870241    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4199b30-045a-4531-98cc-98a260d9dd70-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:57:55.163463 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:55.163175    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:55.172114 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:55.172066    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"]
Oct 30 21:57:55.176826 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:55.176790    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-021907-openshift-default-dfccf5bf7-p2zqw"]
Oct 30 21:57:55.618316 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:55.618281    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" path="/var/lib/kubelet/pods/f4199b30-045a-4531-98cc-98a260d9dd70/volumes"
Oct 30 21:57:57.072343 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:57.072269    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:57.244134 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:57.244097    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:57.373942 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:57.373859    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"]
Oct 30 21:57:57.374117 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:57.374094    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy" containerID="cri-o://1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101" gracePeriod=30
Oct 30 21:57:57.423285 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:57.423246    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:59.265217 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:59.265175    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:57:59.809816 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:57:59.809783    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:01.248521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:01.248484    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:02.623671 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.623648    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:58:02.655924 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.655894    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-podinfo\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656048 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.655942    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-certs\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656048 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.655984    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-data\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656048 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656025    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-socket\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656054    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-envoy\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656110    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-kube-api-access-b4mn4\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-kube-api-access-b4mn4\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656142    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-credential-socket\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656179    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d8f319b-25f0-456a-86e4-d7578c5a244b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8f319b-25f0-456a-86e4-d7578c5a244b-istiod-ca-cert\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656238    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-token\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-token\") pod \"2d8f319b-25f0-456a-86e4-d7578c5a244b\" (UID: \"2d8f319b-25f0-456a-86e4-d7578c5a244b\") "
Oct 30 21:58:02.656448 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656269    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-certs" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:02.656781 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656460    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-credential-socket" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:02.656781 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656641    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-socket" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:02.656781 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656766    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.657065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656784    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.657065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656886    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-data" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:02.657065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656799    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.657065 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.656980    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d8f319b-25f0-456a-86e4-d7578c5a244b-istiod-ca-cert" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:58:02.658643 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.658615    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-podinfo" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:58:02.658830 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.658810    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-kube-api-access-b4mn4" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "kube-api-access-b4mn4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:58:02.658999 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.658977    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-token" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:58:02.659320 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.659302    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-envoy" pod "2d8f319b-25f0-456a-86e4-d7578c5a244b" (UID: "2d8f319b-25f0-456a-86e4-d7578c5a244b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:58:02.758095 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.758064    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.758095 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.758092    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.758095 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.758102    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.758356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.758114    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4mn4\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-kube-api-access-b4mn4\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.758356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.758128    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8f319b-25f0-456a-86e4-d7578c5a244b-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.758356 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.758142    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8f319b-25f0-456a-86e4-d7578c5a244b-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:58:02.784521 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.784489    4943 generic.go:356] "Generic (PLEG): container finished" podID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerID="1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101" exitCode=0
Oct 30 21:58:02.784686 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.784543    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"
Oct 30 21:58:02.784686 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.784597    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" event={"ID":"2d8f319b-25f0-456a-86e4-d7578c5a244b","Type":"ContainerDied","Data":"1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101"}
Oct 30 21:58:02.784686 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.784662    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd" event={"ID":"2d8f319b-25f0-456a-86e4-d7578c5a244b","Type":"ContainerDied","Data":"f637375743d245602591bd7e835c0590da38e7318aa6e7ea3762588b4085c80f"}
Oct 30 21:58:02.785253 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.784694    4943 scope.go:122] "RemoveContainer" containerID="1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101"
Oct 30 21:58:02.797603 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.797582    4943 scope.go:122] "RemoveContainer" containerID="1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101"
Oct 30 21:58:02.797861 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:58:02.797842    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101\": container with ID starting with 1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101 not found: ID does not exist" containerID="1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101"
Oct 30 21:58:02.797945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.797868    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101"} err="failed to get container status \"1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101\": rpc error: code = NotFound desc = could not find container \"1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101\": container with ID starting with 1cc125b6f3c28aa9f2bcd74fa56ced8add217e843ef0c71726e5d789fcd01101 not found: ID does not exist"
Oct 30 21:58:02.954979 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.954897    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"]
Oct 30 21:58:02.958948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:02.958917    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-e4dadd-openshift-default-555c77774c-rt8bd"]
Oct 30 21:58:03.617548 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:03.617505    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" path="/var/lib/kubelet/pods/2d8f319b-25f0-456a-86e4-d7578c5a244b/volumes"
Oct 30 21:58:04.494807 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:04.494660    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:09.200664 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:09.197184    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:10.168844 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:10.168805    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:11.479002 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:11.478967    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:11.685168 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:11.685127    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:14.216727 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:14.216691    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:19.008012 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:19.007961    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:21.066028 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:58:21.065986    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:58:22.236290 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:22.236247    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:23.902880 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:23.902843    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:24.722219 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:24.722184    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:24.912041 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:24.912011    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:28.584181 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:28.584143    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:33.317989 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:33.317947    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:38.016595 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:38.016466    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:42.833799 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:42.833765    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:47.519982 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:47.519943    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:48.716998 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:48.716949    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:48.894015 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:48.893974    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:50.497100 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:50.497057    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:51.066036 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:58:51.066002    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:58:51.598786 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:51.598747    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.102027 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:53.101986    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.387085 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:53.386984    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:53.576611 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:53.576519    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:54.068300 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:54.068261    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:58:58.626881 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:58:58.626845    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:00.350823 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:00.350776    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:00.533661 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:00.533625    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:00.664431 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:00.664398    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"]
Oct 30 21:59:00.664663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:00.664632    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy" containerID="cri-o://745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42" gracePeriod=30
Oct 30 21:59:00.748304 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:00.748274    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:00.952948 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:00.952857    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:01.222346 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:01.222268    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:03.534673 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:03.534636    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:05.959667 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:05.959636    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:59:06.039705 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039675    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-certs\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.039888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039719    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-credential-socket\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.039888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039792    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-podinfo\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.039888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039815    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-kube-api-access-c27kt\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-kube-api-access-c27kt\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.039888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039848    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-token\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-token\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.039888 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039873    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-envoy\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.040140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039960    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8c715a6d-46b0-4817-b8b2-18352dd63802-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c715a6d-46b0-4817-b8b2-18352dd63802-istiod-ca-cert\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.040140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039993    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-data\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.040140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.039996    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-certs" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:06.040140 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.040057    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-socket\") pod \"8c715a6d-46b0-4817-b8b2-18352dd63802\" (UID: \"8c715a6d-46b0-4817-b8b2-18352dd63802\") "
Oct 30 21:59:06.040633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.040430    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-data" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:06.040633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.040522    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.040633 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.040541    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.040845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.040708    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c715a6d-46b0-4817-b8b2-18352dd63802-istiod-ca-cert" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:59:06.040845 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.040780    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-credential-socket" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:06.041009 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.040979    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-socket" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:06.042189 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.042167    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-podinfo" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 21:59:06.042442 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.042406    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-token" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:59:06.042442 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.042434    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-kube-api-access-c27kt" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "kube-api-access-c27kt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:59:06.042582 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.042476    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-envoy" pod "8c715a6d-46b0-4817-b8b2-18352dd63802" (UID: "8c715a6d-46b0-4817-b8b2-18352dd63802"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 21:59:06.141294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.141264    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.141294 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.141293    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.141508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.141305    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c27kt\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-kube-api-access-c27kt\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.141508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.141318    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.141508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.141330    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.141508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.141344    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c715a6d-46b0-4817-b8b2-18352dd63802-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.141508 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.141356    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c715a6d-46b0-4817-b8b2-18352dd63802-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:06.226011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.225922    4943 generic.go:356] "Generic (PLEG): container finished" podID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerID="745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42" exitCode=0
Oct 30 21:59:06.226011 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.225972    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"
Oct 30 21:59:06.226254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.226013    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" event={"ID":"8c715a6d-46b0-4817-b8b2-18352dd63802","Type":"ContainerDied","Data":"745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42"}
Oct 30 21:59:06.226254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.226096    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk" event={"ID":"8c715a6d-46b0-4817-b8b2-18352dd63802","Type":"ContainerDied","Data":"f6e91923b74b5405095cccfe4ef68cfb766689e3aca0358890a41ac5e25dbe44"}
Oct 30 21:59:06.226254 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.226130    4943 scope.go:122] "RemoveContainer" containerID="745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42"
Oct 30 21:59:06.237693 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.237673    4943 scope.go:122] "RemoveContainer" containerID="9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7"
Oct 30 21:59:06.246945 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.246928    4943 scope.go:122] "RemoveContainer" containerID="745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42"
Oct 30 21:59:06.247213 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:59:06.247189    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42\": container with ID starting with 745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42 not found: ID does not exist" containerID="745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42"
Oct 30 21:59:06.247298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.247220    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42"} err="failed to get container status \"745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42\": rpc error: code = NotFound desc = could not find container \"745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42\": container with ID starting with 745109d171cf00f326bce65925f30f2aba6bd474871d0b22b78d6b4185206b42 not found: ID does not exist"
Oct 30 21:59:06.247298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.247245    4943 scope.go:122] "RemoveContainer" containerID="9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7"
Oct 30 21:59:06.247527 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:59:06.247501    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7\": container with ID starting with 9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7 not found: ID does not exist" containerID="9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7"
Oct 30 21:59:06.247680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.247538    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7"} err="failed to get container status \"9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7\": rpc error: code = NotFound desc = could not find container \"9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7\": container with ID starting with 9e7cba2925a06b3af15d174d41727985dffabca134c3894a2dbbfbb7a21a62f7 not found: ID does not exist"
Oct 30 21:59:06.331378 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.331339    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:06.393997 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.393965    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"]
Oct 30 21:59:06.397860 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:06.397838    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w0-d6a241-openshift-default-6694b6c949-87zdk"]
Oct 30 21:59:07.619602 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:07.619545    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" path="/var/lib/kubelet/pods/8c715a6d-46b0-4817-b8b2-18352dd63802/volumes"
Oct 30 21:59:08.545473 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:08.545417    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:13.546314 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:13.546275    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:13.749079 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:13.749036    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:13.941877 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:13.941845    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:18.501766 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:18.501729    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:21.062640 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:59:21.062601    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:59:23.212293 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:23.211522    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:28.152995 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:28.152894    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:32.927393 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:32.927354    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:37.808296 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:37.808247    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:43.323325 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:43.323287    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:43.952789 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:43.952752    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:44.274663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:44.274473    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:44.568035 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:44.567928    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:45.304396 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:45.304360    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:47.470792 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.470755    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"]
Oct 30 21:59:47.471203 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.470953    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7" podUID="4ea37082-158c-4bcb-b9b1-68ab1ee522aa" containerName="maas-api" containerID="cri-o://8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002" gracePeriod=30
Oct 30 21:59:47.616721 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.616680    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:47.795044 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.795015    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:59:47.914933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.914216    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-kube-api-access-4zcz8\" (UniqueName: \"kubernetes.io/projected/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-kube-api-access-4zcz8\") pod \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") "
Oct 30 21:59:47.914933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.914277    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-openshift-service-ca\") pod \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") "
Oct 30 21:59:47.914933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.914368    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls\") pod \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") "
Oct 30 21:59:47.914933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.914526    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-metrics-certs\") pod \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\" (UID: \"4ea37082-158c-4bcb-b9b1-68ab1ee522aa\") "
Oct 30 21:59:47.914933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.914604    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-openshift-service-ca" pod "4ea37082-158c-4bcb-b9b1-68ab1ee522aa" (UID: "4ea37082-158c-4bcb-b9b1-68ab1ee522aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 21:59:47.914933 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.914900    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:47.930279 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.929852    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls" pod "4ea37082-158c-4bcb-b9b1-68ab1ee522aa" (UID: "4ea37082-158c-4bcb-b9b1-68ab1ee522aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:59:47.930279 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.929885    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-kube-api-access-4zcz8" pod "4ea37082-158c-4bcb-b9b1-68ab1ee522aa" (UID: "4ea37082-158c-4bcb-b9b1-68ab1ee522aa"). InnerVolumeSpecName "kube-api-access-4zcz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 21:59:47.931814 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:47.931770    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-metrics-certs" pod "4ea37082-158c-4bcb-b9b1-68ab1ee522aa" (UID: "4ea37082-158c-4bcb-b9b1-68ab1ee522aa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 21:59:48.016117 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.016085    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:48.016117 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.016117    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zcz8\" (UniqueName: \"kubernetes.io/projected/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-kube-api-access-4zcz8\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:48.016337 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.016129    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4ea37082-158c-4bcb-b9b1-68ab1ee522aa-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 21:59:48.503374 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.503344    4943 generic.go:356] "Generic (PLEG): container finished" podID="4ea37082-158c-4bcb-b9b1-68ab1ee522aa" containerID="8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002" exitCode=0
Oct 30 21:59:48.503795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.503394    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"
Oct 30 21:59:48.503795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.503412    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7" event={"ID":"4ea37082-158c-4bcb-b9b1-68ab1ee522aa","Type":"ContainerDied","Data":"8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002"}
Oct 30 21:59:48.503795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.503457    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7" event={"ID":"4ea37082-158c-4bcb-b9b1-68ab1ee522aa","Type":"ContainerDied","Data":"c268a70c4f7895652c9b9f5a46c42ad1749a74a80ea2c4140efea227d826d0e4"}
Oct 30 21:59:48.503795 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.503478    4943 scope.go:122] "RemoveContainer" containerID="8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002"
Oct 30 21:59:48.513539 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.513522    4943 scope.go:122] "RemoveContainer" containerID="8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002"
Oct 30 21:59:48.513865 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:59:48.513846    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002\": container with ID starting with 8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002 not found: ID does not exist" containerID="8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002"
Oct 30 21:59:48.513919 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.513874    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002"} err="failed to get container status \"8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002\": rpc error: code = NotFound desc = could not find container \"8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002\": container with ID starting with 8eac8aabb4fdc1836c442f062d5301700e7c6f890f8c7011e7e94cce4dc33002 not found: ID does not exist"
Oct 30 21:59:48.669812 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.669777    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"]
Oct 30 21:59:48.718956 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:48.718925    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-1b5b5f-586bb9cf5d-7lch7"]
Oct 30 21:59:49.199871 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:49.199836    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:49.441734 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:49.441700    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:49.617545 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:49.617461    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ea37082-158c-4bcb-b9b1-68ab1ee522aa" path="/var/lib/kubelet/pods/4ea37082-158c-4bcb-b9b1-68ab1ee522aa/volumes"
Oct 30 21:59:49.675049 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:49.675017    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:49.862244 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:49.862210    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:50.061415 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:50.061381    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:50.309298 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:50.309265    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:50.815335 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:50.815301    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:51.065021 ip-10-0-135-205 kubenswrapper[4943]: E1030 21:59:51.064973    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 21:59:51.671082 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:51.671038    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:51.909421 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:51.909363    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:54.629185 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:54.629147    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:56.808829 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:56.808795    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.008216 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:57.008162    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.273680 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:57.273641    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:57.419770 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:57.419734    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"]
Oct 30 21:59:57.420003 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:57.419978    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy" containerID="cri-o://29342c7b4f5e3f081dcd34a7961c6729b3d14c518eb8c1784112225c99fd9181" gracePeriod=30
Oct 30 21:59:57.511663 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:57.511572    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 21:59:59.689138 ip-10-0-135-205 kubenswrapper[4943]: I1030 21:59:59.689103    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:00.180375 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180345    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"]
Oct 30 22:00:00.180800 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180787    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180802    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180815    4943 cpu_manager.go:414] "containerMap: removing container" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180821    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180831    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2cf69444-5ab3-4471-8eaf-5479d9b852d8" containerName="maas-api"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180836    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2cf69444-5ab3-4471-8eaf-5479d9b852d8" containerName="maas-api"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180844    4943 cpu_manager.go:414] "containerMap: removing container" podUID="79108e33-0cde-4fb9-a87a-867f6e53915f" containerName="maas-api"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180849    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79108e33-0cde-4fb9-a87a-867f6e53915f" containerName="maas-api"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180860    4943 cpu_manager.go:414] "containerMap: removing container" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy"
Oct 30 22:00:00.180862 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180865    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180873    4943 cpu_manager.go:414] "containerMap: removing container" podUID="953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180878    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180886    4943 cpu_manager.go:414] "containerMap: removing container" podUID="79ff8730-c6df-48ef-8d3e-1378b522a7dd" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180890    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79ff8730-c6df-48ef-8d3e-1378b522a7dd" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180896    4943 cpu_manager.go:414] "containerMap: removing container" podUID="292ea458-d0ad-4357-b260-621f25104384" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180900    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="292ea458-d0ad-4357-b260-621f25104384" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180908    4943 cpu_manager.go:414] "containerMap: removing container" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180913    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180919    4943 cpu_manager.go:414] "containerMap: removing container" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180923    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180929    4943 cpu_manager.go:414] "containerMap: removing container" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180942    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180954    4943 cpu_manager.go:414] "containerMap: removing container" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180958    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180966    4943 cpu_manager.go:414] "containerMap: removing container" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180970    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180977    4943 cpu_manager.go:414] "containerMap: removing container" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180981    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180987    4943 cpu_manager.go:414] "containerMap: removing container" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180991    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.180998    4943 cpu_manager.go:414] "containerMap: removing container" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181002    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181008    4943 cpu_manager.go:414] "containerMap: removing container" podUID="59229a70-7f76-4df9-b52c-93ff26d3aac4" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181014    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="59229a70-7f76-4df9-b52c-93ff26d3aac4" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181022    4943 cpu_manager.go:414] "containerMap: removing container" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181027    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181033    4943 cpu_manager.go:414] "containerMap: removing container" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181037    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181045    4943 cpu_manager.go:414] "containerMap: removing container" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181049    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181057    4943 cpu_manager.go:414] "containerMap: removing container" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181061    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181070    4943 cpu_manager.go:414] "containerMap: removing container" podUID="4ea37082-158c-4bcb-b9b1-68ab1ee522aa" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181074    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ea37082-158c-4bcb-b9b1-68ab1ee522aa" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181082    4943 cpu_manager.go:414] "containerMap: removing container" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181086    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181093    4943 cpu_manager.go:414] "containerMap: removing container" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181097    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181104    4943 cpu_manager.go:414] "containerMap: removing container" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181108    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181115    4943 cpu_manager.go:414] "containerMap: removing container" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181119    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181128    4943 cpu_manager.go:414] "containerMap: removing container" podUID="be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181132    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" containerName="maas-api"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181139    4943 cpu_manager.go:414] "containerMap: removing container" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy"
Oct 30 22:00:00.181168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181143    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181208    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="79ff8730-c6df-48ef-8d3e-1378b522a7dd" containerName="maas-api"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181214    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="292ea458-d0ad-4357-b260-621f25104384" containerName="maas-api"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181222    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="74616002-631e-4d11-b33a-d970a68724f9" containerName="main"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181227    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181233    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181240    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="9659aeba-2abf-4b52-9453-9bfbe0fc07c8" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181246    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4199b30-045a-4531-98cc-98a260d9dd70" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181253    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181259    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181264    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="06706923-8325-472a-9fb8-05f5ff6e0dab" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181270    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="59229a70-7f76-4df9-b52c-93ff26d3aac4" containerName="maas-api"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181275    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181281    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce22d8b2-120f-4a21-ae8f-4b30f3ea5444" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181286    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="585621e7-232f-46fd-a918-e102b539c9d3" containerName="main"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181292    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="459030a0-1766-4829-acb1-d845be102439" containerName="main"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181297    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ea37082-158c-4bcb-b9b1-68ab1ee522aa" containerName="maas-api"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181303    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c6000b6-eebe-41da-981f-f1e9307089f6" containerName="main"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181307    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="10c39742-4da4-468e-88d3-c08cb408d623" containerName="main"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181311    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6dac656-a08e-40ff-8671-0474c7652d40" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181317    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="e5235049-e55c-40f7-bc8a-ca5d63b39946" containerName="main"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181323    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181328    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="be1d5ce2-ca46-4191-b1f3-9f81e8ed4603" containerName="maas-api"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181332    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5d04321-74c7-4770-bce8-0d4b0aaa21c4" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181338    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d8f319b-25f0-456a-86e4-d7578c5a244b" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181342    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="7cf23461-e811-4fd6-8b06-6dae67380128" containerName="istio-proxy"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181347    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2cf69444-5ab3-4471-8eaf-5479d9b852d8" containerName="maas-api"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181352    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="79108e33-0cde-4fb9-a87a-867f6e53915f" containerName="maas-api"
Oct 30 22:00:00.182575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.181357    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="953ba15a-d86e-4b7b-88c2-d2d0b7f3896f" containerName="maas-api"
Oct 30 22:00:00.186013 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.185992    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.188352 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.188332    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"]
Oct 30 22:00:00.188820 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.188800    4943 cpu_manager.go:414] "containerMap: removing container" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy"
Oct 30 22:00:00.188909 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.188820    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c715a6d-46b0-4817-b8b2-18352dd63802" containerName="istio-proxy"
Oct 30 22:00:00.189014 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.188995    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="af2d8b99-00c6-49f4-b48d-ed5fffb21809" containerName="istio-proxy"
Oct 30 22:00:00.192215 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.192195    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.203992 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.203971    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"]
Oct 30 22:00:00.207435 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.207414    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:00.239096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.239078    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6t2c7\""
Oct 30 22:00:00.285137 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.285105    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"]
Oct 30 22:00:00.290456 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.290430    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"]
Oct 30 22:00:00.315850 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.315819    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"]
Oct 30 22:00:00.366839 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.366806    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjdgx\" (UniqueName: \"kubernetes.io/projected/ab530b9d-3b60-4c60-9393-ac4f0c549257-kube-api-access-rjdgx\") pod \"maas-api-key-cleanup-29889960-gtk2k\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.366988 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.366964    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxtch\" (UniqueName: \"kubernetes.io/projected/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-kube-api-access-fxtch\") pod \"maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.367029 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.367003    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.367062 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.367026    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmkjg\" (UniqueName: \"kubernetes.io/projected/0e23e26c-7366-4fd8-9bfd-030c317592d5-kube-api-access-gmkjg\") pod \"maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:00.367101 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.367085    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab530b9d-3b60-4c60-9393-ac4f0c549257-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889960-gtk2k\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.367139 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.367113    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e23e26c-7366-4fd8-9bfd-030c317592d5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:00.468398 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.468321    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e23e26c-7366-4fd8-9bfd-030c317592d5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:00.468398 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.468366    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjdgx\" (UniqueName: \"kubernetes.io/projected/ab530b9d-3b60-4c60-9393-ac4f0c549257-kube-api-access-rjdgx\") pod \"maas-api-key-cleanup-29889960-gtk2k\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.468651 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.468453    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxtch\" (UniqueName: \"kubernetes.io/projected/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-kube-api-access-fxtch\") pod \"maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.468651 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.468475    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.468651 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.468492    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmkjg\" (UniqueName: \"kubernetes.io/projected/0e23e26c-7366-4fd8-9bfd-030c317592d5-kube-api-access-gmkjg\") pod \"maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:00.468651 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.468545    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab530b9d-3b60-4c60-9393-ac4f0c549257-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889960-gtk2k\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.469253 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.469227    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e23e26c-7366-4fd8-9bfd-030c317592d5-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:00.469407 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.469385    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.469449 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.469385    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab530b9d-3b60-4c60-9393-ac4f0c549257-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889960-gtk2k\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.537682 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.537649    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjdgx\" (UniqueName: \"kubernetes.io/projected/ab530b9d-3b60-4c60-9393-ac4f0c549257-kube-api-access-rjdgx\") pod \"maas-api-key-cleanup-29889960-gtk2k\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.539075 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.539048    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmkjg\" (UniqueName: \"kubernetes.io/projected/0e23e26c-7366-4fd8-9bfd-030c317592d5-kube-api-access-gmkjg\") pod \"maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:00.549694 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.549663    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxtch\" (UniqueName: \"kubernetes.io/projected/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-kube-api-access-fxtch\") pod \"maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.798953 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.798870    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:00.807101 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.807071    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:00.821763 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:00.819860    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:01.214797 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.214767    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"]
Oct 30 22:00:01.216384 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:00:01.216357    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab530b9d_3b60_4c60_9393_ac4f0c549257.slice/crio-6ac8780cb489d35e18e6fd093206e490eb7f818b770e1a708d17a30c39e02e45 WatchSource:0}: Error finding container 6ac8780cb489d35e18e6fd093206e490eb7f818b770e1a708d17a30c39e02e45: Status 404 returned error can't find the container with id 6ac8780cb489d35e18e6fd093206e490eb7f818b770e1a708d17a30c39e02e45
Oct 30 22:00:01.262544 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.262516    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"]
Oct 30 22:00:01.264136 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:00:01.264107    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod719cb76e_d7c3_4d8c_be5c_7cd403c30e92.slice/crio-24527e8123c49c738634af53252a5669eaf47cf5bea2bdec1d08b9299866bb7e WatchSource:0}: Error finding container 24527e8123c49c738634af53252a5669eaf47cf5bea2bdec1d08b9299866bb7e: Status 404 returned error can't find the container with id 24527e8123c49c738634af53252a5669eaf47cf5bea2bdec1d08b9299866bb7e
Oct 30 22:00:01.266474 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.266453    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"]
Oct 30 22:00:01.267250 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:00:01.267131    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e23e26c_7366_4fd8_9bfd_030c317592d5.slice/crio-4bfbfcfb51dddf7c4da17aba84ef618d71a13a4b2e414b09d96fa555e033b008 WatchSource:0}: Error finding container 4bfbfcfb51dddf7c4da17aba84ef618d71a13a4b2e414b09d96fa555e033b008: Status 404 returned error can't find the container with id 4bfbfcfb51dddf7c4da17aba84ef618d71a13a4b2e414b09d96fa555e033b008
Oct 30 22:00:01.588936 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.588903    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" event={"ID":"719cb76e-d7c3-4d8c-be5c-7cd403c30e92","Type":"ContainerStarted","Data":"24527e8123c49c738634af53252a5669eaf47cf5bea2bdec1d08b9299866bb7e"}
Oct 30 22:00:01.590495 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.590468    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" event={"ID":"ab530b9d-3b60-4c60-9393-ac4f0c549257","Type":"ContainerStarted","Data":"7ca0e2fe9011b790a0a669546238159739ba31268f1b20033d90a38dcdbe3ba2"}
Oct 30 22:00:01.590641 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.590511    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" event={"ID":"ab530b9d-3b60-4c60-9393-ac4f0c549257","Type":"ContainerStarted","Data":"6ac8780cb489d35e18e6fd093206e490eb7f818b770e1a708d17a30c39e02e45"}
Oct 30 22:00:01.592074 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.592052    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" event={"ID":"0e23e26c-7366-4fd8-9bfd-030c317592d5","Type":"ContainerStarted","Data":"980cbfe6efea38b2bd1a351a58e6346c6c6db1f006cf900f81519880f090d4ba"}
Oct 30 22:00:01.592170 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.592086    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" event={"ID":"0e23e26c-7366-4fd8-9bfd-030c317592d5","Type":"ContainerStarted","Data":"4bfbfcfb51dddf7c4da17aba84ef618d71a13a4b2e414b09d96fa555e033b008"}
Oct 30 22:00:01.723939 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.723893    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" podStartSLOduration=1.723880023 podStartE2EDuration="1.723880023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:01.723708079 +0000 UTC m=+2596.219281429" watchObservedRunningTime="2026-10-30 22:00:01.723880023 +0000 UTC m=+2596.219453408"
Oct 30 22:00:01.842054 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:01.841937    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" podStartSLOduration=1.8419211020000001 podStartE2EDuration="1.841921102s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:00:01.839509015 +0000 UTC m=+2596.335082365" watchObservedRunningTime="2026-10-30 22:00:01.841921102 +0000 UTC m=+2596.337494452"
Oct 30 22:00:02.603352 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.603315    4943 generic.go:356] "Generic (PLEG): container finished" podID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerID="44d404ca71124856e004893b5502091c4e4e5cb230d88dff19e3709dcd7a4073" exitCode=60
Oct 30 22:00:02.603488 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.603391    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" event={"ID":"719cb76e-d7c3-4d8c-be5c-7cd403c30e92","Type":"ContainerDied","Data":"44d404ca71124856e004893b5502091c4e4e5cb230d88dff19e3709dcd7a4073"}
Oct 30 22:00:02.603758 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.603737    4943 scope.go:122] "RemoveContainer" containerID="44d404ca71124856e004893b5502091c4e4e5cb230d88dff19e3709dcd7a4073"
Oct 30 22:00:02.607307 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.607281    4943 generic.go:356] "Generic (PLEG): container finished" podID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerID="7ca0e2fe9011b790a0a669546238159739ba31268f1b20033d90a38dcdbe3ba2" exitCode=60
Oct 30 22:00:02.607389 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.607378    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" event={"ID":"ab530b9d-3b60-4c60-9393-ac4f0c549257","Type":"ContainerDied","Data":"7ca0e2fe9011b790a0a669546238159739ba31268f1b20033d90a38dcdbe3ba2"}
Oct 30 22:00:02.607738 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.607716    4943 scope.go:122] "RemoveContainer" containerID="7ca0e2fe9011b790a0a669546238159739ba31268f1b20033d90a38dcdbe3ba2"
Oct 30 22:00:02.609972 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.609949    4943 generic.go:356] "Generic (PLEG): container finished" podID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerID="29342c7b4f5e3f081dcd34a7961c6729b3d14c518eb8c1784112225c99fd9181" exitCode=0
Oct 30 22:00:02.610080 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.610036    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" event={"ID":"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a","Type":"ContainerDied","Data":"29342c7b4f5e3f081dcd34a7961c6729b3d14c518eb8c1784112225c99fd9181"}
Oct 30 22:00:02.611746 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.611722    4943 generic.go:356] "Generic (PLEG): container finished" podID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerID="980cbfe6efea38b2bd1a351a58e6346c6c6db1f006cf900f81519880f090d4ba" exitCode=60
Oct 30 22:00:02.611886 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.611870    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" event={"ID":"0e23e26c-7366-4fd8-9bfd-030c317592d5","Type":"ContainerDied","Data":"980cbfe6efea38b2bd1a351a58e6346c6c6db1f006cf900f81519880f090d4ba"}
Oct 30 22:00:02.612196 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.612164    4943 scope.go:122] "RemoveContainer" containerID="980cbfe6efea38b2bd1a351a58e6346c6c6db1f006cf900f81519880f090d4ba"
Oct 30 22:00:02.694239 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.694189    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 22:00:02.702582 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702544    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-podinfo\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.702669 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702605    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-credential-socket\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.702669 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702646    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-kube-api-access-tk5xh\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-kube-api-access-tk5xh\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.702760 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702708    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istiod-ca-cert\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.702814 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702759    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-certs\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.702859 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702846    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-envoy\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.702949 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702920    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-socket\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.703026 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702951    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-credential-socket" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:02.703026 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.702966    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-data\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.703138 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703025    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-token\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-token\") pod \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\" (UID: \"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a\") "
Oct 30 22:00:02.703234 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703176    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-certs" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:02.703300 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703267    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istiod-ca-cert" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:02.703923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703482    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-socket" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:02.703923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703640    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-data" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:02.703923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703740    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.703923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703759    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.703923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703774    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.703923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703786    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.703923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.703798    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.705028 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.704963    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-podinfo" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:00:02.705183 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.705133    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-envoy" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:02.706219 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.706193    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-token" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:02.706219 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.706214    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-kube-api-access-tk5xh" pod "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" (UID: "4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"). InnerVolumeSpecName "kube-api-access-tk5xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:02.804266 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.804236    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.804266 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.804262    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.804266 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.804271    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:02.804487 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:02.804280    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk5xh\" (UniqueName: \"kubernetes.io/projected/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a-kube-api-access-tk5xh\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:03.627874 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.627839    4943 generic.go:356] "Generic (PLEG): container finished" podID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerID="8a0bc1e0b9e27779a1c1fdd4e3d0fca559782190123b685a0b175cd11d7fcaa9" exitCode=60
Oct 30 22:00:03.628256 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.627923    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" event={"ID":"719cb76e-d7c3-4d8c-be5c-7cd403c30e92","Type":"ContainerDied","Data":"8a0bc1e0b9e27779a1c1fdd4e3d0fca559782190123b685a0b175cd11d7fcaa9"}
Oct 30 22:00:03.628256 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.627960    4943 scope.go:122] "RemoveContainer" containerID="44d404ca71124856e004893b5502091c4e4e5cb230d88dff19e3709dcd7a4073"
Oct 30 22:00:03.628256 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.628155    4943 scope.go:122] "RemoveContainer" containerID="8a0bc1e0b9e27779a1c1fdd4e3d0fca559782190123b685a0b175cd11d7fcaa9"
Oct 30 22:00:03.628442 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:03.628416    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb_odh-ai-gateway-infra(719cb76e-d7c3-4d8c-be5c-7cd403c30e92)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92"
Oct 30 22:00:03.630142 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.630121    4943 generic.go:356] "Generic (PLEG): container finished" podID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerID="36b4b32f30775d86a5b11b387aab658f88fc2ffef941bb3044b14b6fb51f7222" exitCode=60
Oct 30 22:00:03.630243 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.630212    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" event={"ID":"ab530b9d-3b60-4c60-9393-ac4f0c549257","Type":"ContainerDied","Data":"36b4b32f30775d86a5b11b387aab658f88fc2ffef941bb3044b14b6fb51f7222"}
Oct 30 22:00:03.630430 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.630412    4943 scope.go:122] "RemoveContainer" containerID="36b4b32f30775d86a5b11b387aab658f88fc2ffef941bb3044b14b6fb51f7222"
Oct 30 22:00:03.630659 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:03.630636    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889960-gtk2k_odh-ai-gateway-infra(ab530b9d-3b60-4c60-9393-ac4f0c549257)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257"
Oct 30 22:00:03.631614 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.631590    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x" event={"ID":"4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a","Type":"ContainerDied","Data":"1526cc972bb6bce4942dad582f1c71f87b0237d142c58294a5e73b3f0f59f98c"}
Oct 30 22:00:03.631696 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.631613    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"
Oct 30 22:00:03.633530 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.633510    4943 generic.go:356] "Generic (PLEG): container finished" podID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerID="2e6d4bf5b8035115c777fcd19f3e655122b0206ead21bf1cbc50d9493b8c0b0b" exitCode=60
Oct 30 22:00:03.633642 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.633599    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" event={"ID":"0e23e26c-7366-4fd8-9bfd-030c317592d5","Type":"ContainerDied","Data":"2e6d4bf5b8035115c777fcd19f3e655122b0206ead21bf1cbc50d9493b8c0b0b"}
Oct 30 22:00:03.633859 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.633843    4943 scope.go:122] "RemoveContainer" containerID="2e6d4bf5b8035115c777fcd19f3e655122b0206ead21bf1cbc50d9493b8c0b0b"
Oct 30 22:00:03.634089 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:03.634069    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr_odh-ai-gateway-infra(0e23e26c-7366-4fd8-9bfd-030c317592d5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5"
Oct 30 22:00:03.655846 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.655821    4943 scope.go:122] "RemoveContainer" containerID="7ca0e2fe9011b790a0a669546238159739ba31268f1b20033d90a38dcdbe3ba2"
Oct 30 22:00:03.667481 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.667460    4943 scope.go:122] "RemoveContainer" containerID="29342c7b4f5e3f081dcd34a7961c6729b3d14c518eb8c1784112225c99fd9181"
Oct 30 22:00:03.676876 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.676810    4943 scope.go:122] "RemoveContainer" containerID="980cbfe6efea38b2bd1a351a58e6346c6c6db1f006cf900f81519880f090d4ba"
Oct 30 22:00:03.867946 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.867870    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"]
Oct 30 22:00:03.874810 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:03.874785    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-1b5b5f-openshift-default-59bd77464c-p5w9x"]
Oct 30 22:00:04.642570 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:04.642525    4943 scope.go:122] "RemoveContainer" containerID="8a0bc1e0b9e27779a1c1fdd4e3d0fca559782190123b685a0b175cd11d7fcaa9"
Oct 30 22:00:04.643017 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:04.642781    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb_odh-ai-gateway-infra(719cb76e-d7c3-4d8c-be5c-7cd403c30e92)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92"
Oct 30 22:00:04.644405 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:04.644382    4943 scope.go:122] "RemoveContainer" containerID="36b4b32f30775d86a5b11b387aab658f88fc2ffef941bb3044b14b6fb51f7222"
Oct 30 22:00:04.644668 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:04.644636    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889960-gtk2k_odh-ai-gateway-infra(ab530b9d-3b60-4c60-9393-ac4f0c549257)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257"
Oct 30 22:00:04.646906 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:04.646889    4943 scope.go:122] "RemoveContainer" containerID="2e6d4bf5b8035115c777fcd19f3e655122b0206ead21bf1cbc50d9493b8c0b0b"
Oct 30 22:00:04.647067 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:04.647049    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr_odh-ai-gateway-infra(0e23e26c-7366-4fd8-9bfd-030c317592d5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5"
Oct 30 22:00:04.969021 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:04.968991    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:05.617350 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:05.617315    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" path="/var/lib/kubelet/pods/4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a/volumes"
Oct 30 22:00:09.973113 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:09.973072    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:15.094528 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:15.094487    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:15.623133 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:15.623089    4943 scope.go:122] "RemoveContainer" containerID="8a0bc1e0b9e27779a1c1fdd4e3d0fca559782190123b685a0b175cd11d7fcaa9"
Oct 30 22:00:15.624028 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:15.623663    4943 scope.go:122] "RemoveContainer" containerID="2e6d4bf5b8035115c777fcd19f3e655122b0206ead21bf1cbc50d9493b8c0b0b"
Oct 30 22:00:15.629894 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:15.628478    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"]
Oct 30 22:00:15.629894 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:15.628746    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" containerID="cri-o://0ef001c88007a179c89716a816813e62da8ed48e7fac41d67e2ff7b4af73df35" gracePeriod=30
Oct 30 22:00:15.661156 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:15.661128    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"]
Oct 30 22:00:15.661446 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:15.661385    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" containerID="cri-o://b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c" gracePeriod=30
Oct 30 22:00:16.611079 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.611055    4943 scope.go:122] "RemoveContainer" containerID="36b4b32f30775d86a5b11b387aab658f88fc2ffef941bb3044b14b6fb51f7222"
Oct 30 22:00:16.727100 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.727072    4943 generic.go:356] "Generic (PLEG): container finished" podID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerID="c34e95e26469c5a792b8175b75cb857319607e07356fb073bc870bb827b84778" exitCode=60
Oct 30 22:00:16.727240 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.727144    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" event={"ID":"0e23e26c-7366-4fd8-9bfd-030c317592d5","Type":"ContainerDied","Data":"c34e95e26469c5a792b8175b75cb857319607e07356fb073bc870bb827b84778"}
Oct 30 22:00:16.727240 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.727210    4943 scope.go:122] "RemoveContainer" containerID="2e6d4bf5b8035115c777fcd19f3e655122b0206ead21bf1cbc50d9493b8c0b0b"
Oct 30 22:00:16.727588 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.727533    4943 scope.go:122] "RemoveContainer" containerID="c34e95e26469c5a792b8175b75cb857319607e07356fb073bc870bb827b84778"
Oct 30 22:00:16.727828 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:16.727796    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr_odh-ai-gateway-infra(0e23e26c-7366-4fd8-9bfd-030c317592d5)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5"
Oct 30 22:00:16.729496 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.729471    4943 generic.go:356] "Generic (PLEG): container finished" podID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerID="f2b5ccf1ec076a266afecfa33e6e479b021fee30b7fc104408f94bf04cd8b8dc" exitCode=60
Oct 30 22:00:16.729609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.729510    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" event={"ID":"719cb76e-d7c3-4d8c-be5c-7cd403c30e92","Type":"ContainerDied","Data":"f2b5ccf1ec076a266afecfa33e6e479b021fee30b7fc104408f94bf04cd8b8dc"}
Oct 30 22:00:16.729808 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.729792    4943 scope.go:122] "RemoveContainer" containerID="f2b5ccf1ec076a266afecfa33e6e479b021fee30b7fc104408f94bf04cd8b8dc"
Oct 30 22:00:16.730008 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:16.729993    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb_odh-ai-gateway-infra(719cb76e-d7c3-4d8c-be5c-7cd403c30e92)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92"
Oct 30 22:00:16.740001 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.739981    4943 scope.go:122] "RemoveContainer" containerID="8a0bc1e0b9e27779a1c1fdd4e3d0fca559782190123b685a0b175cd11d7fcaa9"
Oct 30 22:00:16.973208 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.973183    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nb6hp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:00:16.973309 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:16.973225    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:00:17.413323 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:17.413285    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-hdc94 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 30 22:00:17.413494 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:17.413338    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 30 22:00:17.740703 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:17.740617    4943 generic.go:356] "Generic (PLEG): container finished" podID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerID="80a87ad3dc4dfa2816b70353e1065f16e7a24a87265f835212bcfe55b1a918a5" exitCode=60
Oct 30 22:00:17.740703 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:17.740676    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" event={"ID":"ab530b9d-3b60-4c60-9393-ac4f0c549257","Type":"ContainerDied","Data":"80a87ad3dc4dfa2816b70353e1065f16e7a24a87265f835212bcfe55b1a918a5"}
Oct 30 22:00:17.741191 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:17.740719    4943 scope.go:122] "RemoveContainer" containerID="36b4b32f30775d86a5b11b387aab658f88fc2ffef941bb3044b14b6fb51f7222"
Oct 30 22:00:17.741191 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:17.741074    4943 scope.go:122] "RemoveContainer" containerID="80a87ad3dc4dfa2816b70353e1065f16e7a24a87265f835212bcfe55b1a918a5"
Oct 30 22:00:17.741397 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:17.741362    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889960-gtk2k_odh-ai-gateway-infra(ab530b9d-3b60-4c60-9393-ac4f0c549257)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257"
Oct 30 22:00:17.885725 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:17.885689    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"]
Oct 30 22:00:18.013127 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.013097    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"]
Oct 30 22:00:18.030939 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.030913    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:18.155912 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.155887    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:18.168843 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.168820    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e23e26c-7366-4fd8-9bfd-030c317592d5-kube-api-access-gmkjg\" (UniqueName: \"kubernetes.io/projected/0e23e26c-7366-4fd8-9bfd-030c317592d5-kube-api-access-gmkjg\") pod \"0e23e26c-7366-4fd8-9bfd-030c317592d5\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") "
Oct 30 22:00:18.169062 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.169041    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e23e26c-7366-4fd8-9bfd-030c317592d5-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e23e26c-7366-4fd8-9bfd-030c317592d5-maas-api-service-ca\") pod \"0e23e26c-7366-4fd8-9bfd-030c317592d5\" (UID: \"0e23e26c-7366-4fd8-9bfd-030c317592d5\") "
Oct 30 22:00:18.169443 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.169417    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e23e26c-7366-4fd8-9bfd-030c317592d5-maas-api-service-ca" pod "0e23e26c-7366-4fd8-9bfd-030c317592d5" (UID: "0e23e26c-7366-4fd8-9bfd-030c317592d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:18.170842 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.170817    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e23e26c-7366-4fd8-9bfd-030c317592d5-kube-api-access-gmkjg" pod "0e23e26c-7366-4fd8-9bfd-030c317592d5" (UID: "0e23e26c-7366-4fd8-9bfd-030c317592d5"). InnerVolumeSpecName "kube-api-access-gmkjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:18.269990 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.269912    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-maas-api-service-ca\") pod \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") "
Oct 30 22:00:18.270173 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.270152    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-kube-api-access-fxtch\" (UniqueName: \"kubernetes.io/projected/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-kube-api-access-fxtch\") pod \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\" (UID: \"719cb76e-d7c3-4d8c-be5c-7cd403c30e92\") "
Oct 30 22:00:18.270305 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.270277    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-maas-api-service-ca" pod "719cb76e-d7c3-4d8c-be5c-7cd403c30e92" (UID: "719cb76e-d7c3-4d8c-be5c-7cd403c30e92"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:18.270545 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.270520    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e23e26c-7366-4fd8-9bfd-030c317592d5-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:18.270676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.270548    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:18.270676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.270597    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmkjg\" (UniqueName: \"kubernetes.io/projected/0e23e26c-7366-4fd8-9bfd-030c317592d5-kube-api-access-gmkjg\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:18.272903 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.272876    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-kube-api-access-fxtch" pod "719cb76e-d7c3-4d8c-be5c-7cd403c30e92" (UID: "719cb76e-d7c3-4d8c-be5c-7cd403c30e92"). InnerVolumeSpecName "kube-api-access-fxtch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:18.376320 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.376281    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxtch\" (UniqueName: \"kubernetes.io/projected/719cb76e-d7c3-4d8c-be5c-7cd403c30e92-kube-api-access-fxtch\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:18.749218 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.749188    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"
Oct 30 22:00:18.749648 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.749215    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr" event={"ID":"0e23e26c-7366-4fd8-9bfd-030c317592d5","Type":"ContainerDied","Data":"4bfbfcfb51dddf7c4da17aba84ef618d71a13a4b2e414b09d96fa555e033b008"}
Oct 30 22:00:18.749648 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.749277    4943 scope.go:122] "RemoveContainer" containerID="c34e95e26469c5a792b8175b75cb857319607e07356fb073bc870bb827b84778"
Oct 30 22:00:18.750728 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.750703    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb" event={"ID":"719cb76e-d7c3-4d8c-be5c-7cd403c30e92","Type":"ContainerDied","Data":"24527e8123c49c738634af53252a5669eaf47cf5bea2bdec1d08b9299866bb7e"}
Oct 30 22:00:18.750845 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.750744    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"
Oct 30 22:00:18.758940 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.758923    4943 scope.go:122] "RemoveContainer" containerID="f2b5ccf1ec076a266afecfa33e6e479b021fee30b7fc104408f94bf04cd8b8dc"
Oct 30 22:00:18.879716 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.879686    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"]
Oct 30 22:00:18.924418 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.924382    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"]
Oct 30 22:00:18.928733 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:18.928705    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-446ca2-29889960-7nkwb"]
Oct 30 22:00:19.033390 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.033360    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:19.039642 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.039619    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"]
Oct 30 22:00:19.054700 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.054676    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dbe6da-29889960-g4zfr"]
Oct 30 22:00:19.187208 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.187176    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ab530b9d-3b60-4c60-9393-ac4f0c549257-kube-api-access-rjdgx\" (UniqueName: \"kubernetes.io/projected/ab530b9d-3b60-4c60-9393-ac4f0c549257-kube-api-access-rjdgx\") pod \"ab530b9d-3b60-4c60-9393-ac4f0c549257\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") "
Oct 30 22:00:19.187208 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.187214    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ab530b9d-3b60-4c60-9393-ac4f0c549257-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab530b9d-3b60-4c60-9393-ac4f0c549257-maas-api-service-ca\") pod \"ab530b9d-3b60-4c60-9393-ac4f0c549257\" (UID: \"ab530b9d-3b60-4c60-9393-ac4f0c549257\") "
Oct 30 22:00:19.187670 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.187646    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab530b9d-3b60-4c60-9393-ac4f0c549257-maas-api-service-ca" pod "ab530b9d-3b60-4c60-9393-ac4f0c549257" (UID: "ab530b9d-3b60-4c60-9393-ac4f0c549257"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:19.189315 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.189283    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab530b9d-3b60-4c60-9393-ac4f0c549257-kube-api-access-rjdgx" pod "ab530b9d-3b60-4c60-9393-ac4f0c549257" (UID: "ab530b9d-3b60-4c60-9393-ac4f0c549257"). InnerVolumeSpecName "kube-api-access-rjdgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:19.288488 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.288408    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjdgx\" (UniqueName: \"kubernetes.io/projected/ab530b9d-3b60-4c60-9393-ac4f0c549257-kube-api-access-rjdgx\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:19.288488 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.288435    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab530b9d-3b60-4c60-9393-ac4f0c549257-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:19.618205 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.618114    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" path="/var/lib/kubelet/pods/0e23e26c-7366-4fd8-9bfd-030c317592d5/volumes"
Oct 30 22:00:19.618601 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.618576    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" path="/var/lib/kubelet/pods/719cb76e-d7c3-4d8c-be5c-7cd403c30e92/volumes"
Oct 30 22:00:19.759937 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.759907    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"
Oct 30 22:00:19.760409 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.759932    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k" event={"ID":"ab530b9d-3b60-4c60-9393-ac4f0c549257","Type":"ContainerDied","Data":"6ac8780cb489d35e18e6fd093206e490eb7f818b770e1a708d17a30c39e02e45"}
Oct 30 22:00:19.760409 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.760005    4943 scope.go:122] "RemoveContainer" containerID="80a87ad3dc4dfa2816b70353e1065f16e7a24a87265f835212bcfe55b1a918a5"
Oct 30 22:00:19.926290 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.926251    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"]
Oct 30 22:00:19.974820 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:19.974785    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889960-gtk2k"]
Oct 30 22:00:20.165004 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:20.164971    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:20.772364 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:20.772336    4943 generic.go:356] "Generic (PLEG): container finished" podID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerID="0ef001c88007a179c89716a816813e62da8ed48e7fac41d67e2ff7b4af73df35" exitCode=0
Oct 30 22:00:20.772740 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:20.772420    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" event={"ID":"7068b329-7a67-4d7e-8cc9-28305feed3ae","Type":"ContainerDied","Data":"0ef001c88007a179c89716a816813e62da8ed48e7fac41d67e2ff7b4af73df35"}
Oct 30 22:00:20.932622 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:20.932594    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 22:00:21.005988 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.005952    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-envoy\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006157 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006001    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-kube-api-access-w5jgw\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-kube-api-access-w5jgw\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006157 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006077    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-token\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-token\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006157 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006143    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-socket\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006321 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006180    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f355dc1-b56d-446f-930c-f15a88a09d8e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f355dc1-b56d-446f-930c-f15a88a09d8e-istiod-ca-cert\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006321 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006234    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-data\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006321 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006266    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-credential-socket\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006478 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006332    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-podinfo\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006478 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006378    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-certs\") pod \"8f355dc1-b56d-446f-930c-f15a88a09d8e\" (UID: \"8f355dc1-b56d-446f-930c-f15a88a09d8e\") "
Oct 30 22:00:21.006620 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006490    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-socket" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.006620 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006547    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f355dc1-b56d-446f-930c-f15a88a09d8e-istiod-ca-cert" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:21.006741 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006689    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-credential-socket" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.006802 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006768    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-data" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.006853 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006799    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-certs" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.006954 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006936    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.007002 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006960    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.007002 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006976    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f355dc1-b56d-446f-930c-f15a88a09d8e-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.007002 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.006991    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.007127 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.007005    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.008400 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.008375    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-token" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:21.008764 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.008704    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-kube-api-access-w5jgw" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "kube-api-access-w5jgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:21.008764 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.008711    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-envoy" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.008947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.008773    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-podinfo" pod "8f355dc1-b56d-446f-930c-f15a88a09d8e" (UID: "8f355dc1-b56d-446f-930c-f15a88a09d8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:00:21.065676 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:21.065640    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:00:21.108310 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.108275    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.108310 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.108310    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.108502 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.108327    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f355dc1-b56d-446f-930c-f15a88a09d8e-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.108502 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.108341    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5jgw\" (UniqueName: \"kubernetes.io/projected/8f355dc1-b56d-446f-930c-f15a88a09d8e-kube-api-access-w5jgw\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.273355 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.273325    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 22:00:21.411855 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.411823    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-token\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-token\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412022 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.411882    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-credential-socket\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412022 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.411924    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-certs\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412022 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.411979    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-envoy\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412236 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412055    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-socket\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412236 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412088    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7068b329-7a67-4d7e-8cc9-28305feed3ae-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7068b329-7a67-4d7e-8cc9-28305feed3ae-istiod-ca-cert\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412236 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412164    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-podinfo\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412236 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412203    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-certs" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.412236 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412218    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-kube-api-access-ck6ww\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-kube-api-access-ck6ww\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412511 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412254    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-credential-socket" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.412511 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412273    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-data\") pod \"7068b329-7a67-4d7e-8cc9-28305feed3ae\" (UID: \"7068b329-7a67-4d7e-8cc9-28305feed3ae\") "
Oct 30 22:00:21.412511 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412491    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7068b329-7a67-4d7e-8cc9-28305feed3ae-istiod-ca-cert" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:21.412738 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412617    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-socket" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.412864 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412675    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-data" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.412864 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412683    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.413051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412881    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.413051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.412899    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7068b329-7a67-4d7e-8cc9-28305feed3ae-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.414239 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.414217    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-token" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:21.414580 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.414549    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-podinfo" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:00:21.414782 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.414769    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-kube-api-access-ck6ww" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "kube-api-access-ck6ww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:21.414891 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.414876    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-envoy" pod "7068b329-7a67-4d7e-8cc9-28305feed3ae" (UID: "7068b329-7a67-4d7e-8cc9-28305feed3ae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:21.513847 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.513764    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.513847 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.513796    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.513847 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.513807    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.513847 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.513816    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ck6ww\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-kube-api-access-ck6ww\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.513847 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.513827    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.513847 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.513835    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7068b329-7a67-4d7e-8cc9-28305feed3ae-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:21.617775 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.617739    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" path="/var/lib/kubelet/pods/ab530b9d-3b60-4c60-9393-ac4f0c549257/volumes"
Oct 30 22:00:21.780604 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.780487    4943 generic.go:356] "Generic (PLEG): container finished" podID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerID="b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c" exitCode=0
Oct 30 22:00:21.780604 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.780585    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"
Oct 30 22:00:21.781139 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.780594    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" event={"ID":"8f355dc1-b56d-446f-930c-f15a88a09d8e","Type":"ContainerDied","Data":"b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c"}
Oct 30 22:00:21.781139 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.780671    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp" event={"ID":"8f355dc1-b56d-446f-930c-f15a88a09d8e","Type":"ContainerDied","Data":"90c488a39d9d9993565c934871d65ae3b325538f2635f1be1407f078ebdaa648"}
Oct 30 22:00:21.781139 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.780692    4943 scope.go:122] "RemoveContainer" containerID="b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c"
Oct 30 22:00:21.783032 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.782908    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"
Oct 30 22:00:21.783032 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.782937    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94" event={"ID":"7068b329-7a67-4d7e-8cc9-28305feed3ae","Type":"ContainerDied","Data":"a17b7f05cd7fb9483ac7d6b0457e33a0ffc2c9ea615e0fed0bff02fd3abb84fa"}
Oct 30 22:00:21.792373 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.792353    4943 scope.go:122] "RemoveContainer" containerID="b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c"
Oct 30 22:00:21.792642 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:21.792622    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c\": container with ID starting with b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c not found: ID does not exist" containerID="b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c"
Oct 30 22:00:21.792737 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.792654    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c"} err="failed to get container status \"b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c\": rpc error: code = NotFound desc = could not find container \"b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c\": container with ID starting with b1b3fbdad1bb87faf56ae629071cf9683928b205463f1d453ac3f3ffc8de847c not found: ID does not exist"
Oct 30 22:00:21.792737 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.792677    4943 scope.go:122] "RemoveContainer" containerID="0ef001c88007a179c89716a816813e62da8ed48e7fac41d67e2ff7b4af73df35"
Oct 30 22:00:21.950734 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.950703    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"]
Oct 30 22:00:21.999859 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:21.999830    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nb6hp"]
Oct 30 22:00:22.108918 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:22.108836    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"]
Oct 30 22:00:22.116013 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:22.115988    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-hdc94"]
Oct 30 22:00:23.617528 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:23.617495    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" path="/var/lib/kubelet/pods/7068b329-7a67-4d7e-8cc9-28305feed3ae/volumes"
Oct 30 22:00:23.617985 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:23.617970    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" path="/var/lib/kubelet/pods/8f355dc1-b56d-446f-930c-f15a88a09d8e/volumes"
Oct 30 22:00:25.043040 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:25.042987    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:30.012871 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:30.012826    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:33.650938 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:33.650897    4943 pod_container_manager_linux.go:218] "Failed to delete cgroup paths" cgroupName=["kubepods","burstable","pod4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a"] err="unable to destroy cgroup paths for cgroup [kubepods burstable pod4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a] : Timed out while waiting for systemd to remove kubepods-burstable-pod4a5ff4c6_2fb8_4c18_b45c_8b26d5bb355a.slice"
Oct 30 22:00:33.650938 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:33.650936    4943 kubelet_pods.go:2797] "Failed to destroy orphaned pod cgroup" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" err="failed to delete cgroup paths for [kubepods burstable pod4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a] : unable to destroy cgroup paths for cgroup [kubepods burstable pod4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a] : Timed out while waiting for systemd to remove kubepods-burstable-pod4a5ff4c6_2fb8_4c18_b45c_8b26d5bb355a.slice"
Oct 30 22:00:34.445094 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:34.445041    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:36.023999 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:36.023960    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:36.357842 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:36.357750    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:36.603226 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:36.603191    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:41.570289 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:41.570246    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:46.591793 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:46.591756    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:48.377449 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:48.377410    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"]
Oct 30 22:00:48.378094 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:48.377662    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy" containerID="cri-o://20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465" gracePeriod=30
Oct 30 22:00:51.062925 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:51.062888    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:00:51.157192 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:51.157152    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:51.594280 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:51.594223    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:00:53.642203 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.642179    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 22:00:53.729963 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.729871    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/817405c4-95b9-4d99-a283-717b7b075c76-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817405c4-95b9-4d99-a283-717b7b075c76-istio-podinfo\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.729963 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.729939    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-kube-api-access-j2ms4\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-kube-api-access-j2ms4\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730210 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.729990    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-credential-socket\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730210 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730020    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-certs\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730210 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730082    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-data\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730210 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730150    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-socket\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730210 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730181    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/817405c4-95b9-4d99-a283-717b7b075c76-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817405c4-95b9-4d99-a283-717b7b075c76-istiod-ca-cert\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730492 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730242    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-envoy\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730492 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730271    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-istio-token\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-istio-token\") pod \"817405c4-95b9-4d99-a283-717b7b075c76\" (UID: \"817405c4-95b9-4d99-a283-717b7b075c76\") "
Oct 30 22:00:53.730677 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730644    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-socket" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:53.730912 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.730878    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-data" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:53.732172 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.732135    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-certs" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:53.732280 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.732238    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-credential-socket" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:53.732443 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.732408    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/817405c4-95b9-4d99-a283-717b7b075c76-istiod-ca-cert" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:00:53.732881 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.732851    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-kube-api-access-j2ms4" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "kube-api-access-j2ms4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:53.732975 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.732940    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-istio-token" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:00:53.733182 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.733155    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/817405c4-95b9-4d99-a283-717b7b075c76-istio-podinfo" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:00:53.734047 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.734018    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-envoy" pod "817405c4-95b9-4d99-a283-717b7b075c76" (UID: "817405c4-95b9-4d99-a283-717b7b075c76"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:00:53.831314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831282    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831310    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831319    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/817405c4-95b9-4d99-a283-717b7b075c76-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831330    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831339    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831350    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/817405c4-95b9-4d99-a283-717b7b075c76-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831358    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2ms4\" (UniqueName: \"kubernetes.io/projected/817405c4-95b9-4d99-a283-717b7b075c76-kube-api-access-j2ms4\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831367    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.831546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.831375    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/817405c4-95b9-4d99-a283-717b7b075c76-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:00:53.991312 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.991231    4943 generic.go:356] "Generic (PLEG): container finished" podID="817405c4-95b9-4d99-a283-717b7b075c76" containerID="20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465" exitCode=0
Oct 30 22:00:53.991312 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.991304    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"
Oct 30 22:00:53.991524 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.991320    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" event={"ID":"817405c4-95b9-4d99-a283-717b7b075c76","Type":"ContainerDied","Data":"20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465"}
Oct 30 22:00:53.991524 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.991376    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2" event={"ID":"817405c4-95b9-4d99-a283-717b7b075c76","Type":"ContainerDied","Data":"1b884311c852428df41a395eb678155b56cb986564a43f06b1a011dbd8d93ccc"}
Oct 30 22:00:53.991524 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:53.991401    4943 scope.go:122] "RemoveContainer" containerID="20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465"
Oct 30 22:00:54.001929 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:54.001909    4943 scope.go:122] "RemoveContainer" containerID="20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465"
Oct 30 22:00:54.002184 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:00:54.002164    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465\": container with ID starting with 20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465 not found: ID does not exist" containerID="20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465"
Oct 30 22:00:54.002242 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:54.002196    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465"} err="failed to get container status \"20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465\": rpc error: code = NotFound desc = could not find container \"20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465\": container with ID starting with 20d4ecda6bb75d15d9ee90136e5d5bca9f44a7909c1043b1bebbc8fcc9806465 not found: ID does not exist"
Oct 30 22:00:54.157867 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:54.157825    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"]
Oct 30 22:00:54.175197 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:54.175153    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-07fa8e-openshift-default-756d98f699-9qxx2"]
Oct 30 22:00:55.618462 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:55.618429    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="817405c4-95b9-4d99-a283-717b7b075c76" path="/var/lib/kubelet/pods/817405c4-95b9-4d99-a283-717b7b075c76/volumes"
Oct 30 22:00:56.534486 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:00:56.534450    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:00.852959 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:00.852928    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:01.464455 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:01.464422    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:04.457287 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:04.457235    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:04.681742 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:04.681710    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:04.916353 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:04.916306    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:06.703894 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:06.703864    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:07.203427 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:07.203365    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:07.424421 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:07.424364    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:11.912729 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:11.912681    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:16.823338 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:16.823298    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:18.967521 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:18.967486    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:21.067572 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:01:21.067517    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:01:21.748600 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:21.747202    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:26.406407 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:26.406350    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:31.051237 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:31.051196    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:32.533171 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:32.533129    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:36.026617 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:36.025196    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:40.826590 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:40.826060    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:45.700579 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:45.699782    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:46.108270 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:46.108194    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:01:46.114917 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:46.114888    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:01:50.512508 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:50.512465    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:51.066400 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:01:51.066357    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:01:51.472750 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:51.472717    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:54.278926 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.278875    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"]
Oct 30 22:01:54.279513 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279493    4943 cpu_manager.go:414] "containerMap: removing container" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy"
Oct 30 22:01:54.279609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279514    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy"
Oct 30 22:01:54.279609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279541    4943 cpu_manager.go:414] "containerMap: removing container" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:01:54.279609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279549    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:01:54.279609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279580    4943 cpu_manager.go:414] "containerMap: removing container" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279589    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279602    4943 cpu_manager.go:414] "containerMap: removing container" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:01:54.279609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279611    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279628    4943 cpu_manager.go:414] "containerMap: removing container" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279635    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279647    4943 cpu_manager.go:414] "containerMap: removing container" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279653    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279664    4943 cpu_manager.go:414] "containerMap: removing container" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279672    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279700    4943 cpu_manager.go:414] "containerMap: removing container" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279707    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279724    4943 cpu_manager.go:414] "containerMap: removing container" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279731    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279739    4943 cpu_manager.go:414] "containerMap: removing container" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279746    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279777    4943 cpu_manager.go:414] "containerMap: removing container" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279784    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279879    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f355dc1-b56d-446f-930c-f15a88a09d8e" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279890    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279901    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279910    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279919    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279928    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279936    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a5ff4c6-2fb8-4c18-b45c-8b26d5bb355a" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279945    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279956    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="817405c4-95b9-4d99-a283-717b7b075c76" containerName="istio-proxy"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279965    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:01:54.279970 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.279972    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="7068b329-7a67-4d7e-8cc9-28305feed3ae" containerName="istio-proxy"
Oct 30 22:01:54.284663 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.284639    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.336729 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.336699    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-75c2acf6-openshift-default-dockercfg-q8244\""
Oct 30 22:01:54.429475 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.429443    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b5b746-993c-4824-acdc-2e8c5b524329-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.429670 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.429494    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.429670 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.429644    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bf9h\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-kube-api-access-7bf9h\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.429763 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.429730    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.429844 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.429821    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.429900 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.429856    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.429900 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.429880    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b5b746-993c-4824-acdc-2e8c5b524329-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.430037 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.430020    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.430100 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.430050    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.481706 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.481668    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"]
Oct 30 22:01:54.531351 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531273    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531351 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531317    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531586 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531502    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b5b746-993c-4824-acdc-2e8c5b524329-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531586 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531576    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531711 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531651    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bf9h\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-kube-api-access-7bf9h\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531770 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531714    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531770 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531744    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531770 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531754    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531912 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531781    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.531912 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.531817    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b5b746-993c-4824-acdc-2e8c5b524329-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.532035 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.532015    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.532084 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.532034    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.532161 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.532137    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.532626 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.532604    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b5b746-993c-4824-acdc-2e8c5b524329-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.533827 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.533803    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.534348 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.534325    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b5b746-993c-4824-acdc-2e8c5b524329-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.589241 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.589204    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.589426 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.589320    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bf9h\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-kube-api-access-7bf9h\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:54.600046 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:54.600019    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:55.033519 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.033491    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"]
Oct 30 22:01:55.035056 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:01:55.035028    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86b5b746_993c_4824_acdc_2e8c5b524329.slice/crio-8de21eda66b18c266447244b8a8e9fa3ce6d30423a5c650b97bdcd55500a5a42 WatchSource:0}: Error finding container 8de21eda66b18c266447244b8a8e9fa3ce6d30423a5c650b97bdcd55500a5a42: Status 404 returned error can't find the container with id 8de21eda66b18c266447244b8a8e9fa3ce6d30423a5c650b97bdcd55500a5a42
Oct 30 22:01:55.037290 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.037258    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:01:55.037385 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.037320    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:01:55.037385 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.037347    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:01:55.288634 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.288449    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:01:55.363883 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.363842    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" event={"ID":"86b5b746-993c-4824-acdc-2e8c5b524329","Type":"ContainerStarted","Data":"6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550"}
Oct 30 22:01:55.364082 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.363945    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" event={"ID":"86b5b746-993c-4824-acdc-2e8c5b524329","Type":"ContainerStarted","Data":"8de21eda66b18c266447244b8a8e9fa3ce6d30423a5c650b97bdcd55500a5a42"}
Oct 30 22:01:55.491578 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.489495    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" podStartSLOduration=1.489475774 podStartE2EDuration="1.489475774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:01:55.486051311 +0000 UTC m=+2709.981624676" watchObservedRunningTime="2026-10-30 22:01:55.489475774 +0000 UTC m=+2709.985049127"
Oct 30 22:01:55.600700 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:55.600622    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:01:56.602145 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:56.602109    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:01:56.602691 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:56.602189    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:01:57.600951 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:57.600919    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:01:57.601219 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:57.600971    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:01:58.600890 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:58.600852    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:01:58.601388 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:58.600942    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:01:59.600571 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:59.600521    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:01:59.600774 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:01:59.600606    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:02:00.157009 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:00.156971    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:00.601017 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:00.600928    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused" start-of-body=
Oct 30 22:02:00.601017 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:00.600991    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.122:15021/healthz/ready\": dial tcp 10.132.0.122:15021: connect: connection refused"
Oct 30 22:02:01.817472 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:01.817437    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:02:01.818018 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:01.817867    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:02:01.818950 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:01.818927    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:02:02.656571 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:02.656525    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:04.901117 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:04.901076    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:09.400367 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.400333    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"]
Oct 30 22:02:09.400891 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.400839    4943 cpu_manager.go:414] "containerMap: removing container" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:02:09.400891 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.400854    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0e23e26c-7366-4fd8-9bfd-030c317592d5" containerName="cleanup"
Oct 30 22:02:09.400891 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.400876    4943 cpu_manager.go:414] "containerMap: removing container" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:02:09.400891 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.400881    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:02:09.401026 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.400988    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="ab530b9d-3b60-4c60-9393-ac4f0c549257" containerName="cleanup"
Oct 30 22:02:09.401026 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.401001    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="719cb76e-d7c3-4d8c-be5c-7cd403c30e92" containerName="cleanup"
Oct 30 22:02:09.404256 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.404235    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.505647 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.505606    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/237d7c10-b29f-4629-9799-929f21401145-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.505916 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.505734    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.505916 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.505807    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.505916 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.505867    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.505916 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.505898    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.506180 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.505943    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84dm5\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-kube-api-access-84dm5\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.506180 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.505973    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.506180 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.506002    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.506180 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.506038    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/237d7c10-b29f-4629-9799-929f21401145-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.508349 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.508320    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"]
Oct 30 22:02:09.607477 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607445    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607706 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607493    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607706 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607514    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607706 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607539    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84dm5\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-kube-api-access-84dm5\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607706 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607673    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607716    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607750    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/237d7c10-b29f-4629-9799-929f21401145-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607791    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/237d7c10-b29f-4629-9799-929f21401145-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607901    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.607947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607927    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.608162 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.607964    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.608162 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.608125    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.608320 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.608300    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.608510 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.608487    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/237d7c10-b29f-4629-9799-929f21401145-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.610126 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.610100    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.610292 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.610276    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/237d7c10-b29f-4629-9799-929f21401145-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.665542 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.665488    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.665692 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.665674    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84dm5\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-kube-api-access-84dm5\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.718199 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.718175    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:09.958960 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:09.958880    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:10.148003 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.147965    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"]
Oct 30 22:02:10.188764 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:02:10.188733    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod237d7c10_b29f_4629_9799_929f21401145.slice/crio-8f738cf6ea69f8b90fdb21d4d09c1895e84cd3a93a6f069f9c3201d2144418e5 WatchSource:0}: Error finding container 8f738cf6ea69f8b90fdb21d4d09c1895e84cd3a93a6f069f9c3201d2144418e5: Status 404 returned error can't find the container with id 8f738cf6ea69f8b90fdb21d4d09c1895e84cd3a93a6f069f9c3201d2144418e5
Oct 30 22:02:10.191767 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.191735    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:02:10.191836 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.191803    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:02:10.191878 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.191834    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:02:10.460792 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.460758    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" event={"ID":"237d7c10-b29f-4629-9799-929f21401145","Type":"ContainerStarted","Data":"d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281"}
Oct 30 22:02:10.461227 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.460815    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" event={"ID":"237d7c10-b29f-4629-9799-929f21401145","Type":"ContainerStarted","Data":"8f738cf6ea69f8b90fdb21d4d09c1895e84cd3a93a6f069f9c3201d2144418e5"}
Oct 30 22:02:10.582040 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.581930    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" podStartSLOduration=1.5819129859999999 podStartE2EDuration="1.581912986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:10.578518251 +0000 UTC m=+2725.074091610" watchObservedRunningTime="2026-10-30 22:02:10.581912986 +0000 UTC m=+2725.077486407"
Oct 30 22:02:10.718687 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:10.718639    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:11.720733 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:11.720696    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:02:11.721110 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:11.720758    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:02:12.719330 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:12.719298    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:02:12.719504 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:12.719347    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:02:13.719275 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:13.719242    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:02:13.719711 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:13.719300    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:02:14.719022 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:14.718989    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:02:14.719210 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:14.719081    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:02:14.799945 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:14.794625    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:15.719251 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:15.719216    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused" start-of-body=
Oct 30 22:02:15.719507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:15.719276    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.123:15021/healthz/ready\": dial tcp 10.132.0.123:15021: connect: connection refused"
Oct 30 22:02:16.722921 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:16.722891    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:16.723412 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:16.723396    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:16.724193 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:16.724168    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:02:19.502519 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:19.502335    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:21.063166 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:02:21.063134    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:02:24.398581 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.398481    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:24.502712 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.502676    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"]
Oct 30 22:02:24.506491 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.506473    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.566906 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.566871    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"]
Oct 30 22:02:24.591114 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591077    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45310248-a2aa-4851-ad39-7540074f1692-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591280 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591131    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591344 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591321    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591411 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591392    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591467 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591452    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591511 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591496    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4ntt\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-kube-api-access-j4ntt\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591588 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591525    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591667 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591639    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.591795 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.591776    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45310248-a2aa-4851-ad39-7540074f1692-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.692590 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692494    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4ntt\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-kube-api-access-j4ntt\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.692590 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692528    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.692590 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692551    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.692871 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692672    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45310248-a2aa-4851-ad39-7540074f1692-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.692871 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692727    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45310248-a2aa-4851-ad39-7540074f1692-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.692871 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692762    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.692871 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692864    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.693097 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692928    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.693097 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692972    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.693097 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.692995    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-data\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.693262 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.693167    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-certs\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.693371 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.693350    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-credential-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.693438 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.693415    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-socket\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.693721 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.693702    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45310248-a2aa-4851-ad39-7540074f1692-istiod-ca-cert\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.695245 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.695223    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45310248-a2aa-4851-ad39-7540074f1692-istio-podinfo\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.695307 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.695251    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-envoy\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.750128 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.750097    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-istio-token\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.750128 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.750115    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4ntt\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-kube-api-access-j4ntt\") pod \"e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") " pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:24.820981 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:24.820945    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:25.255184 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.255159    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"]
Oct 30 22:02:25.256309 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:02:25.256285    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45310248_a2aa_4851_ad39_7540074f1692.slice/crio-893028d7f3054e597cf90c6e964bfb82c7660d7488d1817077c18c7809428467 WatchSource:0}: Error finding container 893028d7f3054e597cf90c6e964bfb82c7660d7488d1817077c18c7809428467: Status 404 returned error can't find the container with id 893028d7f3054e597cf90c6e964bfb82c7660d7488d1817077c18c7809428467
Oct 30 22:02:25.258882 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.258850    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:02:25.258979 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.258914    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:02:25.258979 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.258946    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:02:25.575496 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.575408    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" event={"ID":"45310248-a2aa-4851-ad39-7540074f1692","Type":"ContainerStarted","Data":"1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd"}
Oct 30 22:02:25.575496 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.575459    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" event={"ID":"45310248-a2aa-4851-ad39-7540074f1692","Type":"ContainerStarted","Data":"893028d7f3054e597cf90c6e964bfb82c7660d7488d1817077c18c7809428467"}
Oct 30 22:02:25.740468 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.740414    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" podStartSLOduration=1.740402338 podStartE2EDuration="1.740402338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:02:25.740171949 +0000 UTC m=+2740.235745302" watchObservedRunningTime="2026-10-30 22:02:25.740402338 +0000 UTC m=+2740.235975688"
Oct 30 22:02:25.821480 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:25.821452    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:26.823696 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:26.823618    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:02:26.823696 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:26.823673    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:02:27.821833 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:27.821798    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:02:27.822015 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:27.821871    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:02:28.821462 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:28.821429    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:02:28.821978 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:28.821487    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:02:29.462154 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:29.462117    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:29.821853 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:29.821772    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:02:29.821853 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:29.821826    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:02:30.821836 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:30.821800    4943 patch_prober.go:29] interesting pod/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused" start-of-body=
Oct 30 22:02:30.822053 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:30.821855    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.124:15021/healthz/ready\": dial tcp 10.132.0.124:15021: connect: connection refused"
Oct 30 22:02:31.825212 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:31.825182    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:31.825738 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:31.825493    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:31.826242 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:31.826223    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:02:33.227797 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:33.227766    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:33.404154 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:33.404121    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:34.290460 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:34.290423    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:39.051863 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:39.051823    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:40.285153 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:40.285115    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:44.193865 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:44.193769    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:49.012799 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:49.012761    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:51.063750 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:02:51.063712    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:02:51.801301 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:51.801264    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:52.640986 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:52.640949    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:52.814233 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:52.814192    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:53.708378 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:53.708323    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:57.965298 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:57.965261    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:59.494742 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:59.494692    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:59.704987 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:59.704946    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:02:59.889371 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:02:59.889300    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:04.783497 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:04.783440    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:08.943857 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:08.943824    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:10.438949 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:10.438908    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:10.702757 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:10.702657    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:10.875507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:10.875472    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:15.698772 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:15.698736    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:20.383125 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:20.383095    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:20.557117 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:20.557080    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:21.062601 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:03:21.062537    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:03:21.325967 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:21.325892    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:25.115757 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:25.115704    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:25.605365 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:25.605330    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:27.535676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:27.535549    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:27.731980 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:27.731932    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:27.815576 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:27.815489    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"]
Oct 30 22:03:27.815746 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:27.815722    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy" containerID="cri-o://e72f22822a1f00b270ea076841d133806ca72e5332ba3b14e0a699f507cb643c" gracePeriod=30
Oct 30 22:03:27.929532 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:27.929483    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:30.265260 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:30.265217    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:33.031118 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.031086    4943 generic.go:356] "Generic (PLEG): container finished" podID="504172ff-ddd4-4772-8a1d-674ab6557357" containerID="e72f22822a1f00b270ea076841d133806ca72e5332ba3b14e0a699f507cb643c" exitCode=0
Oct 30 22:03:33.031505 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.031163    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" event={"ID":"504172ff-ddd4-4772-8a1d-674ab6557357","Type":"ContainerDied","Data":"e72f22822a1f00b270ea076841d133806ca72e5332ba3b14e0a699f507cb643c"}
Oct 30 22:03:33.031505 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.031240    4943 scope.go:122] "RemoveContainer" containerID="c1caf948ec563fc3ef5e90cd583f0f505d54b28cf78149ad2bbe32d6172e39b2"
Oct 30 22:03:33.082439 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.082387    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 22:03:33.164710 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164686    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-socket\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.164840 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164723    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-certs\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.164840 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164755    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/504172ff-ddd4-4772-8a1d-674ab6557357-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504172ff-ddd4-4772-8a1d-674ab6557357-istio-podinfo\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.164840 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164822    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-envoy\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.164996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164865    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-kube-api-access-g6l9z\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-kube-api-access-g6l9z\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.164996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164932    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/504172ff-ddd4-4772-8a1d-674ab6557357-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504172ff-ddd4-4772-8a1d-674ab6557357-istiod-ca-cert\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.164996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164978    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-socket" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:33.165167 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.164993    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-certs" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:33.165167 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165004    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-istio-token\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-istio-token\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.165167 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165046    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-credential-socket\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.165167 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165098    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-data\") pod \"504172ff-ddd4-4772-8a1d-674ab6557357\" (UID: \"504172ff-ddd4-4772-8a1d-674ab6557357\") "
Oct 30 22:03:33.165392 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165308    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504172ff-ddd4-4772-8a1d-674ab6557357-istiod-ca-cert" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:03:33.165459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165372    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-credential-socket" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:33.165819 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165548    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-data" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:33.165819 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165599    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.165819 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165615    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.165819 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165626    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.165819 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.165637    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/504172ff-ddd4-4772-8a1d-674ab6557357-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.167128 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.167103    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-istio-token" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:33.167239 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.167182    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-envoy" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:03:33.167474 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.167455    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-kube-api-access-g6l9z" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "kube-api-access-g6l9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:03:33.167594 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.167465    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/504172ff-ddd4-4772-8a1d-674ab6557357-istio-podinfo" pod "504172ff-ddd4-4772-8a1d-674ab6557357" (UID: "504172ff-ddd4-4772-8a1d-674ab6557357"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:03:33.266874 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.266846    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/504172ff-ddd4-4772-8a1d-674ab6557357-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.266874 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.266874    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.267051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.266884    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6l9z\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-kube-api-access-g6l9z\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.267051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.266894    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/504172ff-ddd4-4772-8a1d-674ab6557357-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:33.267051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:33.266903    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/504172ff-ddd4-4772-8a1d-674ab6557357-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:03:34.038076 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:34.038049    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"
Oct 30 22:03:34.038474 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:34.038049    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp" event={"ID":"504172ff-ddd4-4772-8a1d-674ab6557357","Type":"ContainerDied","Data":"aefe0652d058b6587dbbb25bc36dc2418a37b95a9d4b3033313787dc623d2ed0"}
Oct 30 22:03:34.038474 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:34.038178    4943 scope.go:122] "RemoveContainer" containerID="e72f22822a1f00b270ea076841d133806ca72e5332ba3b14e0a699f507cb643c"
Oct 30 22:03:34.260155 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:34.260111    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"]
Oct 30 22:03:34.260356 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:34.260194    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e9aa8e-openshift-default-67b95c54df-m7wqp"]
Oct 30 22:03:35.206437 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:35.206393    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:35.619407 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:35.619333    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" path="/var/lib/kubelet/pods/504172ff-ddd4-4772-8a1d-674ab6557357/volumes"
Oct 30 22:03:40.089640 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:40.089596    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:40.679878 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:40.679835    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:40.913359 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:40.913322    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:45.102145 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:45.102098    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:49.806352 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:49.806290    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:51.062706 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:03:51.062668    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:03:52.170859 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:52.170823    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:53.912993 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:53.912950    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:55.513697 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:55.513666    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:55.745362 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:55.745312    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:55.926834 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:55.926792    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:03:56.406894 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:03:56.406836    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:00.740507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:00.740467    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:01.653318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:01.653287    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:01.898474 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:01.898440    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:03.249424 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:03.249390    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:03.451687 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:03.451653    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:03.641271 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:03.641194    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:03.828237 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:03.828201    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:05.527858 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:05.527821    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:07.887544 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:07.887509    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:09.166791 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.166746    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:09.366025 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.365987    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:09.447611 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.447528    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"]
Oct 30 22:04:09.447879 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.447832    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy" containerID="cri-o://6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550" gracePeriod=30
Oct 30 22:04:09.462924 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.462898    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"]
Oct 30 22:04:09.463154 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.463126    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy" containerID="cri-o://d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281" gracePeriod=30
Oct 30 22:04:09.486902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.486870    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"]
Oct 30 22:04:09.487117 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.487094    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy" containerID="cri-o://1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd" gracePeriod=30
Oct 30 22:04:09.556229 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.556191    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:09.981343 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:09.981309    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:10.392767 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:10.392642    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:14.159615 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.159580    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:14.455953 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.455853    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:14.841411 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.841385    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:04:14.844418 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.844393    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:04:14.848418 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.848393    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:04:14.899852 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.899799    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/45310248-a2aa-4851-ad39-7540074f1692-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45310248-a2aa-4851-ad39-7540074f1692-istio-podinfo\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.900068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.899862    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/45310248-a2aa-4851-ad39-7540074f1692-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45310248-a2aa-4851-ad39-7540074f1692-istiod-ca-cert\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.900068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.899897    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-envoy\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.899942    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-socket\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.899971    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-kube-api-access-7bf9h\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-kube-api-access-7bf9h\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.900068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.899995    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-istio-token\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-istio-token\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.900068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900029    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/237d7c10-b29f-4629-9799-929f21401145-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/237d7c10-b29f-4629-9799-929f21401145-istio-podinfo\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900066    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-data\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900098    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-kube-api-access-j4ntt\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-kube-api-access-j4ntt\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900135    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-istio-token\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-istio-token\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900169    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-envoy\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900200    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-certs\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900250    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-credential-socket\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900286    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-socket\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900335    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-kube-api-access-84dm5\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-kube-api-access-84dm5\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900367    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-credential-socket\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900396    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-certs\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900422    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/237d7c10-b29f-4629-9799-929f21401145-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/237d7c10-b29f-4629-9799-929f21401145-istiod-ca-cert\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.900459 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900459    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-istio-token\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-istio-token\") pod \"237d7c10-b29f-4629-9799-929f21401145\" (UID: \"237d7c10-b29f-4629-9799-929f21401145\") "
Oct 30 22:04:14.901318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900492    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-certs\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.901318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900981    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-credential-socket\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.901318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.901040    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86b5b746-993c-4824-acdc-2e8c5b524329-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b5b746-993c-4824-acdc-2e8c5b524329-istiod-ca-cert\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.901318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.901074    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-data\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.901318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.901114    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-data\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.901318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.901147    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-socket\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.902986 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.902234    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-envoy\") pod \"45310248-a2aa-4851-ad39-7540074f1692\" (UID: \"45310248-a2aa-4851-ad39-7540074f1692\") "
Oct 30 22:04:14.902986 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.902281    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/86b5b746-993c-4824-acdc-2e8c5b524329-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b5b746-993c-4824-acdc-2e8c5b524329-istio-podinfo\") pod \"86b5b746-993c-4824-acdc-2e8c5b524329\" (UID: \"86b5b746-993c-4824-acdc-2e8c5b524329\") "
Oct 30 22:04:14.903595 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900274    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45310248-a2aa-4851-ad39-7540074f1692-istiod-ca-cert" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:14.903595 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.903215    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-certs" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.903595 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900506    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-socket" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.903595 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.900782    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-socket" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.903595 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.902839    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-data" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.903595 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.903148    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-credential-socket" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.903595 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.903183    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-credential-socket" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.904041 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.903966    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-envoy" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.905096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.904261    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-data" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.905096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.904505    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-socket" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.905096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.904746    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-certs" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.905096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.904824    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-data" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.905096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.904975    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-certs" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.905096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.905058    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/237d7c10-b29f-4629-9799-929f21401145-istiod-ca-cert" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:14.905438 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.905133    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86b5b746-993c-4824-acdc-2e8c5b524329-istiod-ca-cert" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:14.905438 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.905135    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/45310248-a2aa-4851-ad39-7540074f1692-istio-podinfo" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:04:14.905749 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.905725    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-credential-socket" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.906083 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.906058    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86b5b746-993c-4824-acdc-2e8c5b524329-istio-podinfo" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:04:14.906196 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.906169    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-envoy" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.907106 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.907082    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-kube-api-access-7bf9h" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "kube-api-access-7bf9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:14.907840 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.907820    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-kube-api-access-j4ntt" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "kube-api-access-j4ntt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:14.907946 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.907922    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-kube-api-access-84dm5" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "kube-api-access-84dm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:14.908036 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.907977    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-istio-token" pod "86b5b746-993c-4824-acdc-2e8c5b524329" (UID: "86b5b746-993c-4824-acdc-2e8c5b524329"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:14.908036 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.907990    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-istio-token" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:14.908149 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.908077    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/237d7c10-b29f-4629-9799-929f21401145-istio-podinfo" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:04:14.908885 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.908864    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-istio-token" pod "237d7c10-b29f-4629-9799-929f21401145" (UID: "237d7c10-b29f-4629-9799-929f21401145"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:14.909335 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.909311    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-envoy" pod "45310248-a2aa-4851-ad39-7540074f1692" (UID: "45310248-a2aa-4851-ad39-7540074f1692"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:14.947973 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:14.947938    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"]
Oct 30 22:04:15.004096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004059    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004087    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004097    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004106    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004116    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84dm5\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-kube-api-access-84dm5\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004126    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004134    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004142    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/237d7c10-b29f-4629-9799-929f21401145-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004150    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/237d7c10-b29f-4629-9799-929f21401145-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004159    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004168    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004176    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86b5b746-993c-4824-acdc-2e8c5b524329-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004184    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86b5b746-993c-4824-acdc-2e8c5b524329-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004192    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004200    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004207    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45310248-a2aa-4851-ad39-7540074f1692-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004215    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86b5b746-993c-4824-acdc-2e8c5b524329-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004224    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45310248-a2aa-4851-ad39-7540074f1692-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004232    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45310248-a2aa-4851-ad39-7540074f1692-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004240    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004248    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004256    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bf9h\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-kube-api-access-7bf9h\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004264    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004271    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/237d7c10-b29f-4629-9799-929f21401145-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004279    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/237d7c10-b29f-4629-9799-929f21401145-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004290    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4ntt\" (UniqueName: \"kubernetes.io/projected/45310248-a2aa-4851-ad39-7540074f1692-kube-api-access-j4ntt\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.004329 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.004299    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86b5b746-993c-4824-acdc-2e8c5b524329-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:15.069676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.069588    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:15.288297 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.288263    4943 generic.go:356] "Generic (PLEG): container finished" podID="45310248-a2aa-4851-ad39-7540074f1692" containerID="1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd" exitCode=0
Oct 30 22:04:15.288735 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.288312    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"
Oct 30 22:04:15.288735 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.288337    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" event={"ID":"45310248-a2aa-4851-ad39-7540074f1692","Type":"ContainerDied","Data":"1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd"}
Oct 30 22:04:15.288735 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.288396    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2" event={"ID":"45310248-a2aa-4851-ad39-7540074f1692","Type":"ContainerDied","Data":"893028d7f3054e597cf90c6e964bfb82c7660d7488d1817077c18c7809428467"}
Oct 30 22:04:15.288735 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.288415    4943 scope.go:122] "RemoveContainer" containerID="1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd"
Oct 30 22:04:15.290546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.290484    4943 generic.go:356] "Generic (PLEG): container finished" podID="86b5b746-993c-4824-acdc-2e8c5b524329" containerID="6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550" exitCode=0
Oct 30 22:04:15.290779 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.290612    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"
Oct 30 22:04:15.291024 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.290630    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" event={"ID":"86b5b746-993c-4824-acdc-2e8c5b524329","Type":"ContainerDied","Data":"6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550"}
Oct 30 22:04:15.291207 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.291185    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c" event={"ID":"86b5b746-993c-4824-acdc-2e8c5b524329","Type":"ContainerDied","Data":"8de21eda66b18c266447244b8a8e9fa3ce6d30423a5c650b97bdcd55500a5a42"}
Oct 30 22:04:15.296088 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.296065    4943 generic.go:356] "Generic (PLEG): container finished" podID="237d7c10-b29f-4629-9799-929f21401145" containerID="d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281" exitCode=0
Oct 30 22:04:15.296209 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.296177    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" event={"ID":"237d7c10-b29f-4629-9799-929f21401145","Type":"ContainerDied","Data":"d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281"}
Oct 30 22:04:15.296269 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.296216    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx" event={"ID":"237d7c10-b29f-4629-9799-929f21401145","Type":"ContainerDied","Data":"8f738cf6ea69f8b90fdb21d4d09c1895e84cd3a93a6f069f9c3201d2144418e5"}
Oct 30 22:04:15.296328 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.296303    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"
Oct 30 22:04:15.302417 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.302396    4943 scope.go:122] "RemoveContainer" containerID="1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd"
Oct 30 22:04:15.302734 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:15.302707    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd\": container with ID starting with 1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd not found: ID does not exist" containerID="1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd"
Oct 30 22:04:15.302840 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.302746    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd"} err="failed to get container status \"1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd\": rpc error: code = NotFound desc = could not find container \"1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd\": container with ID starting with 1b333f442b13b6c2ed65c31bd577b0ff1fe267c3631c91665714720a9f03d1dd not found: ID does not exist"
Oct 30 22:04:15.302840 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.302768    4943 scope.go:122] "RemoveContainer" containerID="6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550"
Oct 30 22:04:15.313231 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.313210    4943 scope.go:122] "RemoveContainer" containerID="6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550"
Oct 30 22:04:15.313532 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:15.313512    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550\": container with ID starting with 6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550 not found: ID does not exist" containerID="6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550"
Oct 30 22:04:15.313600 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.313544    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550"} err="failed to get container status \"6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550\": rpc error: code = NotFound desc = could not find container \"6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550\": container with ID starting with 6a005b459b3589127a7564ac134c1067ec32296f6a1147254d0a401e8dc07550 not found: ID does not exist"
Oct 30 22:04:15.313600 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.313578    4943 scope.go:122] "RemoveContainer" containerID="d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281"
Oct 30 22:04:15.322416 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.322395    4943 scope.go:122] "RemoveContainer" containerID="d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281"
Oct 30 22:04:15.322766 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:15.322748    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281\": container with ID starting with d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281 not found: ID does not exist" containerID="d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281"
Oct 30 22:04:15.322841 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.322774    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281"} err="failed to get container status \"d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281\": rpc error: code = NotFound desc = could not find container \"d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281\": container with ID starting with d851f7a0c8efb79dad507dca429ecc71e317ae7abed0efdc557db6e6ffc4b281 not found: ID does not exist"
Oct 30 22:04:15.528996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.528962    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"]
Oct 30 22:04:15.533547 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.533516    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-fzr6c"]
Oct 30 22:04:15.627025 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.626946    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" path="/var/lib/kubelet/pods/86b5b746-993c-4824-acdc-2e8c5b524329/volumes"
Oct 30 22:04:15.630278 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.630250    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:15.644171 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.644147    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"]
Oct 30 22:04:15.650253 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.650227    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-qf7v2"]
Oct 30 22:04:15.758915 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.758881    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"]
Oct 30 22:04:15.764527 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:15.764499    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-75c2acf6-openshift-default-74d4bc544f-8njpx"]
Oct 30 22:04:17.618251 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:17.618217    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="237d7c10-b29f-4629-9799-929f21401145" path="/var/lib/kubelet/pods/237d7c10-b29f-4629-9799-929f21401145/volumes"
Oct 30 22:04:17.618797 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:17.618777    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45310248-a2aa-4851-ad39-7540074f1692" path="/var/lib/kubelet/pods/45310248-a2aa-4851-ad39-7540074f1692/volumes"
Oct 30 22:04:19.071030 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:19.070994    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"]
Oct 30 22:04:19.392500 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:19.392425    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:20.951028 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:20.951000    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:21.062930 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:21.062891    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:04:22.466530 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:22.466497    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:22.648047 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:22.648008    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:25.942662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:25.942626    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:26.564328 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:26.564271    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:26.754508 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:26.754470    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:29.968424 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:29.968377    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" containerID="cri-o://f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b" gracePeriod=45
Oct 30 22:04:30.013271 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.013236    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main" probeResult="failure" output="Get \"https://10.132.0.66:8000/ready\": dial tcp 10.132.0.66:8000: connect: connection refused"
Oct 30 22:04:30.230593 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.230501    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 22:04:30.316092 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.316053    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:30.356330 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356296    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-model-cache\") pod \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") "
Oct 30 22:04:30.356501 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356389    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/585b14ad-5aa4-4c2e-8b92-aa3eee706914-kube-api-access-w2vbs\" (UniqueName: \"kubernetes.io/projected/585b14ad-5aa4-4c2e-8b92-aa3eee706914-kube-api-access-w2vbs\") pod \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") "
Oct 30 22:04:30.356501 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356432    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-dshm\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-dshm\") pod \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") "
Oct 30 22:04:30.356501 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356485    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-home\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-home\") pod \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") "
Oct 30 22:04:30.356662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356532    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tls-certs\" (UniqueName: \"kubernetes.io/secret/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tls-certs\") pod \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") "
Oct 30 22:04:30.356662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356592    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tmp-dir\") pod \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\" (UID: \"585b14ad-5aa4-4c2e-8b92-aa3eee706914\") "
Oct 30 22:04:30.356662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356601    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-model-cache" pod "585b14ad-5aa4-4c2e-8b92-aa3eee706914" (UID: "585b14ad-5aa4-4c2e-8b92-aa3eee706914"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:30.356887 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356831    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-home" pod "585b14ad-5aa4-4c2e-8b92-aa3eee706914" (UID: "585b14ad-5aa4-4c2e-8b92-aa3eee706914"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:30.356961 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.356906    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tmp-dir" pod "585b14ad-5aa4-4c2e-8b92-aa3eee706914" (UID: "585b14ad-5aa4-4c2e-8b92-aa3eee706914"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:30.357017 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.357000    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:30.357075 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.357019    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:30.359414 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.359387    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/585b14ad-5aa4-4c2e-8b92-aa3eee706914-kube-api-access-w2vbs" pod "585b14ad-5aa4-4c2e-8b92-aa3eee706914" (UID: "585b14ad-5aa4-4c2e-8b92-aa3eee706914"). InnerVolumeSpecName "kube-api-access-w2vbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:30.359585 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.359426    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-dshm" pod "585b14ad-5aa4-4c2e-8b92-aa3eee706914" (UID: "585b14ad-5aa4-4c2e-8b92-aa3eee706914"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:30.359585 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.359435    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tls-certs" pod "585b14ad-5aa4-4c2e-8b92-aa3eee706914" (UID: "585b14ad-5aa4-4c2e-8b92-aa3eee706914"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:04:30.413156 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.412837    4943 generic.go:356] "Generic (PLEG): container finished" podID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerID="f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b" exitCode=0
Oct 30 22:04:30.413156 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.412897    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"
Oct 30 22:04:30.413156 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.412904    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" event={"ID":"585b14ad-5aa4-4c2e-8b92-aa3eee706914","Type":"ContainerDied","Data":"f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b"}
Oct 30 22:04:30.413156 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.412963    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5" event={"ID":"585b14ad-5aa4-4c2e-8b92-aa3eee706914","Type":"ContainerDied","Data":"6393faaca29f98de96536903e55f2aacf66402be66fb80e062e76d574f936346"}
Oct 30 22:04:30.413156 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.413003    4943 scope.go:122] "RemoveContainer" containerID="f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b"
Oct 30 22:04:30.427375 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.427344    4943 scope.go:122] "RemoveContainer" containerID="f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b"
Oct 30 22:04:30.427753 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:30.427733    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b\": container with ID starting with f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b not found: ID does not exist" containerID="f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b"
Oct 30 22:04:30.427826 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.427764    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b"} err="failed to get container status \"f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b\": rpc error: code = NotFound desc = could not find container \"f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b\": container with ID starting with f9d408b78760027ca461c1a3e024ef20b52b8efa0d9237c890113cdae84aa26b not found: ID does not exist"
Oct 30 22:04:30.458030 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.457999    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2vbs\" (UniqueName: \"kubernetes.io/projected/585b14ad-5aa4-4c2e-8b92-aa3eee706914-kube-api-access-w2vbs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:30.458030 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.458029    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:30.458234 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.458051    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:30.458234 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.458065    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/585b14ad-5aa4-4c2e-8b92-aa3eee706914-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:30.587802 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.587705    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"]
Oct 30 22:04:30.591279 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:30.591248    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-07fa8e/premium-w4-07fa8e-kserve-6957576dc5-srxw5"]
Oct 30 22:04:31.618574 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:31.618522    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" path="/var/lib/kubelet/pods/585b14ad-5aa4-4c2e-8b92-aa3eee706914/volumes"
Oct 30 22:04:34.091288 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.091240    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" containerID="cri-o://caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d" gracePeriod=45
Oct 30 22:04:34.214974 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.214935    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": dial tcp 10.132.0.71:8000: connect: connection refused"
Oct 30 22:04:34.350434 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.350373    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 22:04:34.403078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403045    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-home\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-home\") pod \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") "
Oct 30 22:04:34.403247 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403094    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tls-certs\" (UniqueName: \"kubernetes.io/secret/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tls-certs\") pod \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") "
Oct 30 22:04:34.403247 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403124    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-kube-api-access-r4zh2\" (UniqueName: \"kubernetes.io/projected/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-kube-api-access-r4zh2\") pod \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") "
Oct 30 22:04:34.403247 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403174    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tmp-dir\") pod \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") "
Oct 30 22:04:34.403431 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403263    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-dshm\") pod \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") "
Oct 30 22:04:34.403431 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403339    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-home" pod "8092e5b2-176a-4a50-930e-b0d2cf4c20c3" (UID: "8092e5b2-176a-4a50-930e-b0d2cf4c20c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:34.403431 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403350    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-model-cache\") pod \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\" (UID: \"8092e5b2-176a-4a50-930e-b0d2cf4c20c3\") "
Oct 30 22:04:34.403623 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403503    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tmp-dir" pod "8092e5b2-176a-4a50-930e-b0d2cf4c20c3" (UID: "8092e5b2-176a-4a50-930e-b0d2cf4c20c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:34.403675 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403615    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-model-cache" pod "8092e5b2-176a-4a50-930e-b0d2cf4c20c3" (UID: "8092e5b2-176a-4a50-930e-b0d2cf4c20c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:34.403675 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403622    4943 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-home\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:34.403675 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.403669    4943 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tmp-dir\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:34.405450 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.405407    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-dshm" pod "8092e5b2-176a-4a50-930e-b0d2cf4c20c3" (UID: "8092e5b2-176a-4a50-930e-b0d2cf4c20c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:04:34.405616 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.405452    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-kube-api-access-r4zh2" pod "8092e5b2-176a-4a50-930e-b0d2cf4c20c3" (UID: "8092e5b2-176a-4a50-930e-b0d2cf4c20c3"). InnerVolumeSpecName "kube-api-access-r4zh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:34.405616 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.405522    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tls-certs" pod "8092e5b2-176a-4a50-930e-b0d2cf4c20c3" (UID: "8092e5b2-176a-4a50-930e-b0d2cf4c20c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:04:34.437468 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.437444    4943 generic.go:356] "Generic (PLEG): container finished" podID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerID="caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d" exitCode=0
Oct 30 22:04:34.437612 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.437486    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"
Oct 30 22:04:34.437612 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.437534    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" event={"ID":"8092e5b2-176a-4a50-930e-b0d2cf4c20c3","Type":"ContainerDied","Data":"caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d"}
Oct 30 22:04:34.437612 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.437597    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t" event={"ID":"8092e5b2-176a-4a50-930e-b0d2cf4c20c3","Type":"ContainerDied","Data":"52dbb93a2441d873286647f3b75cd249811be5baa9731a4f8a571960b11605b6"}
Oct 30 22:04:34.437774 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.437620    4943 scope.go:122] "RemoveContainer" containerID="caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d"
Oct 30 22:04:34.448454 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.448435    4943 scope.go:122] "RemoveContainer" containerID="caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d"
Oct 30 22:04:34.448750 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:34.448731    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d\": container with ID starting with caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d not found: ID does not exist" containerID="caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d"
Oct 30 22:04:34.448809 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.448759    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d"} err="failed to get container status \"caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d\": rpc error: code = NotFound desc = could not find container \"caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d\": container with ID starting with caa7469d6560ca4c633b0f1c5f74a1c4eb711a4ae9ff973298b7b07b4fb29f0d not found: ID does not exist"
Oct 30 22:04:34.505136 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.505099    4943 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-dshm\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:34.505136 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.505126    4943 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-model-cache\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:34.505136 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.505136    4943 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-tls-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:34.505423 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.505146    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4zh2\" (UniqueName: \"kubernetes.io/projected/8092e5b2-176a-4a50-930e-b0d2cf4c20c3-kube-api-access-r4zh2\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:34.581674 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.581643    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"]
Oct 30 22:04:34.583651 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:34.583630    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-446ca2/distinct-w2-446ca2-kserve-5b9c5b5467-j2g4t"]
Oct 30 22:04:35.617769 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:35.617735    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" path="/var/lib/kubelet/pods/8092e5b2-176a-4a50-930e-b0d2cf4c20c3/volumes"
Oct 30 22:04:40.115149 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.115106    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"]
Oct 30 22:04:40.115634 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.115363    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf" podUID="2d4b97c7-2e09-42a1-b01a-a739c91c36dc" containerName="maas-api" containerID="cri-o://834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487" gracePeriod=30
Oct 30 22:04:40.255800 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.255645    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:40.418581 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.418538    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 22:04:40.465370 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.465334    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls\") pod \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") "
Oct 30 22:04:40.465581 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.465414    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-kube-api-access-fr4r4\" (UniqueName: \"kubernetes.io/projected/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-kube-api-access-fr4r4\") pod \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") "
Oct 30 22:04:40.465581 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.465439    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-metrics-certs\") pod \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") "
Oct 30 22:04:40.465581 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.465503    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-openshift-service-ca\") pod \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\" (UID: \"2d4b97c7-2e09-42a1-b01a-a739c91c36dc\") "
Oct 30 22:04:40.466006 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.465969    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-openshift-service-ca" pod "2d4b97c7-2e09-42a1-b01a-a739c91c36dc" (UID: "2d4b97c7-2e09-42a1-b01a-a739c91c36dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:04:40.467670 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.467640    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-kube-api-access-fr4r4" pod "2d4b97c7-2e09-42a1-b01a-a739c91c36dc" (UID: "2d4b97c7-2e09-42a1-b01a-a739c91c36dc"). InnerVolumeSpecName "kube-api-access-fr4r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:04:40.467769 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.467678    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-metrics-certs" pod "2d4b97c7-2e09-42a1-b01a-a739c91c36dc" (UID: "2d4b97c7-2e09-42a1-b01a-a739c91c36dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:04:40.467769 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.467710    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls" pod "2d4b97c7-2e09-42a1-b01a-a739c91c36dc" (UID: "2d4b97c7-2e09-42a1-b01a-a739c91c36dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:04:40.475763 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.475737    4943 generic.go:356] "Generic (PLEG): container finished" podID="2d4b97c7-2e09-42a1-b01a-a739c91c36dc" containerID="834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487" exitCode=0
Oct 30 22:04:40.475852 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.475791    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"
Oct 30 22:04:40.475915 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.475856    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf" event={"ID":"2d4b97c7-2e09-42a1-b01a-a739c91c36dc","Type":"ContainerDied","Data":"834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487"}
Oct 30 22:04:40.475915 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.475911    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf" event={"ID":"2d4b97c7-2e09-42a1-b01a-a739c91c36dc","Type":"ContainerDied","Data":"e5c32864ec79e347de84c2ac0de363e37f4ebd359a8001ecf710d654c6cb10da"}
Oct 30 22:04:40.475994 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.475936    4943 scope.go:122] "RemoveContainer" containerID="834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487"
Oct 30 22:04:40.502767 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.502736    4943 scope.go:122] "RemoveContainer" containerID="834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487"
Oct 30 22:04:40.503214 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:40.503133    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487\": container with ID starting with 834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487 not found: ID does not exist" containerID="834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487"
Oct 30 22:04:40.503214 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.503178    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487"} err="failed to get container status \"834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487\": rpc error: code = NotFound desc = could not find container \"834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487\": container with ID starting with 834a79697cf3b0a28300050479b4db5d47212f0457dac392152ecd794981e487 not found: ID does not exist"
Oct 30 22:04:40.567095 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.567062    4943 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-openshift-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:40.567095 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.567088    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-maas-api-tls\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:40.567303 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.567119    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fr4r4\" (UniqueName: \"kubernetes.io/projected/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-kube-api-access-fr4r4\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:40.567303 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.567129    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d4b97c7-2e09-42a1-b01a-a739c91c36dc-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:04:40.651599 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.651524    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"]
Oct 30 22:04:40.655971 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:40.655938    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-446ca2-77f79976c5-lftdf"]
Oct 30 22:04:41.617455 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:41.617420    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d4b97c7-2e09-42a1-b01a-a739c91c36dc" path="/var/lib/kubelet/pods/2d4b97c7-2e09-42a1-b01a-a739c91c36dc/volumes"
Oct 30 22:04:41.772446 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:41.772414    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:42.052940 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:42.052905    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:42.701367 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:42.701322    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:47.043652 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:47.043616    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:48.578191 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:48.578154    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:48.830768 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:48.830684    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:49.035591 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:49.035541    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:49.364149 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:49.364111    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:50.839648 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:50.839605    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:51.062664 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:04:51.062630    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:04:51.181731 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:51.181695    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:51.771462 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:51.771428    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:51.957987 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:51.957950    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:52.268741 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:52.268709    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:52.480967 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:52.480918    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:53.218680 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:53.218643    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:56.882541 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:56.882505    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:57.080402 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:57.080369    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:57.576028 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:57.575990    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:57.772615 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:57.772579    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:57.959987 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:57.959954    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:04:59.054811 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:04:59.054770    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:13.197984 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.197946    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58d6bcb5f-zqwb8"]
Oct 30 22:05:13.198507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.198162    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerName="manager" containerID="cri-o://9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d" gracePeriod=30
Oct 30 22:05:13.472976 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.472952    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 22:05:13.522174 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.522140    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-webhook-cert\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-webhook-cert\") pod \"8946ba66-fc18-4527-a27b-dd93cf55f850\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") "
Oct 30 22:05:13.522294 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.522282    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-metrics-certs\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-metrics-certs\") pod \"8946ba66-fc18-4527-a27b-dd93cf55f850\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") "
Oct 30 22:05:13.522351 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.522328    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8946ba66-fc18-4527-a27b-dd93cf55f850-kube-api-access-m74rg\" (UniqueName: \"kubernetes.io/projected/8946ba66-fc18-4527-a27b-dd93cf55f850-kube-api-access-m74rg\") pod \"8946ba66-fc18-4527-a27b-dd93cf55f850\" (UID: \"8946ba66-fc18-4527-a27b-dd93cf55f850\") "
Oct 30 22:05:13.524138 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.524111    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-webhook-cert" pod "8946ba66-fc18-4527-a27b-dd93cf55f850" (UID: "8946ba66-fc18-4527-a27b-dd93cf55f850"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:05:13.524255 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.524233    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8946ba66-fc18-4527-a27b-dd93cf55f850-kube-api-access-m74rg" pod "8946ba66-fc18-4527-a27b-dd93cf55f850" (UID: "8946ba66-fc18-4527-a27b-dd93cf55f850"). InnerVolumeSpecName "kube-api-access-m74rg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:13.524339 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.524263    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-metrics-certs" pod "8946ba66-fc18-4527-a27b-dd93cf55f850" (UID: "8946ba66-fc18-4527-a27b-dd93cf55f850"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:05:13.623111 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.623082    4943 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-metrics-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:13.623111 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.623109    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m74rg\" (UniqueName: \"kubernetes.io/projected/8946ba66-fc18-4527-a27b-dd93cf55f850-kube-api-access-m74rg\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:13.623351 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.623120    4943 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8946ba66-fc18-4527-a27b-dd93cf55f850-webhook-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:13.667963 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.667921    4943 generic.go:356] "Generic (PLEG): container finished" podID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerID="9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d" exitCode=0
Oct 30 22:05:13.668132 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.667985    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" event={"ID":"8946ba66-fc18-4527-a27b-dd93cf55f850","Type":"ContainerDied","Data":"9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d"}
Oct 30 22:05:13.668132 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.668071    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8" event={"ID":"8946ba66-fc18-4527-a27b-dd93cf55f850","Type":"ContainerDied","Data":"6370eaf453463396d389173889d25795536a8a150527e3b4dca7edc13cb0b2fc"}
Oct 30 22:05:13.668132 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.668086    4943 scope.go:122] "RemoveContainer" containerID="9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d"
Oct 30 22:05:13.668286 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.667994    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-58d6bcb5f-zqwb8"
Oct 30 22:05:13.677826 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.677796    4943 scope.go:122] "RemoveContainer" containerID="459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152"
Oct 30 22:05:13.686429 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.686412    4943 scope.go:122] "RemoveContainer" containerID="9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d"
Oct 30 22:05:13.686700 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:05:13.686681    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d\": container with ID starting with 9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d not found: ID does not exist" containerID="9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d"
Oct 30 22:05:13.686761 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.686711    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d"} err="failed to get container status \"9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d\": rpc error: code = NotFound desc = could not find container \"9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d\": container with ID starting with 9ccdf557710c1ebf8523186aa994eb9ecdd6d7b7f1eda4505ca057895f69068d not found: ID does not exist"
Oct 30 22:05:13.686761 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.686728    4943 scope.go:122] "RemoveContainer" containerID="459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152"
Oct 30 22:05:13.686954 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:05:13.686935    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152\": container with ID starting with 459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152 not found: ID does not exist" containerID="459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152"
Oct 30 22:05:13.686995 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.686962    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152"} err="failed to get container status \"459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152\": rpc error: code = NotFound desc = could not find container \"459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152\": container with ID starting with 459832c623e058deb3a6278bc5bea43df04ad8bdffd37fa0ffaa50bb61204152 not found: ID does not exist"
Oct 30 22:05:13.831327 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.831238    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-58d6bcb5f-zqwb8"]
Oct 30 22:05:13.835462 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:13.835436    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-58d6bcb5f-zqwb8"]
Oct 30 22:05:15.619976 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:15.619939    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" path="/var/lib/kubelet/pods/8946ba66-fc18-4527-a27b-dd93cf55f850/volumes"
Oct 30 22:05:18.042196 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:18.042142    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"]
Oct 30 22:05:18.042777 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:18.042425    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" containerID="cri-o://758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3" gracePeriod=30
Oct 30 22:05:18.108405 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:18.108376    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-nsqr4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:05:18.108676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:18.108643    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:05:20.501522 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:20.501490    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:21.063279 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:05:21.063237    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:05:23.297029 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.297005    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 22:05:23.423236 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423209    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-certs\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423421 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423261    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-token\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-token\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423421 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423291    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-credential-socket\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423421 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423314    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-socket\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423421 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423362    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-data\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423421 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423395    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-envoy\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423421 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423421    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-kube-api-access-64cdk\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-kube-api-access-64cdk\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423464    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-certs" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.423902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423475    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7f7721f4-0078-43e6-be9c-3250a4a3e250-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7721f4-0078-43e6-be9c-3250a4a3e250-istiod-ca-cert\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423580    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-podinfo\") pod \"7f7721f4-0078-43e6-be9c-3250a4a3e250\" (UID: \"7f7721f4-0078-43e6-be9c-3250a4a3e250\") "
Oct 30 22:05:23.423902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423663    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-socket" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.423902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423694    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-credential-socket" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.423902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423787    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-data" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.424217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.423979    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.424217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.424000    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.424217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.424014    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.424217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.424026    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.424217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.424031    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7721f4-0078-43e6-be9c-3250a4a3e250-istiod-ca-cert" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:05:23.425702 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.425675    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-token" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:23.425802 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.425760    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-podinfo" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:05:23.426066 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.426043    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-envoy" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:05:23.426109 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.426054    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-kube-api-access-64cdk" pod "7f7721f4-0078-43e6-be9c-3250a4a3e250" (UID: "7f7721f4-0078-43e6-be9c-3250a4a3e250"). InnerVolumeSpecName "kube-api-access-64cdk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:05:23.525110 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.525076    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.525110 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.525106    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64cdk\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-kube-api-access-64cdk\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.525110 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.525117    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f7721f4-0078-43e6-be9c-3250a4a3e250-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.525330 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.525127    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.525330 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.525135    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f7721f4-0078-43e6-be9c-3250a4a3e250-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:05:23.734962 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.734877    4943 generic.go:356] "Generic (PLEG): container finished" podID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerID="758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3" exitCode=0
Oct 30 22:05:23.734962 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.734921    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"
Oct 30 22:05:23.735174 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.734959    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" event={"ID":"7f7721f4-0078-43e6-be9c-3250a4a3e250","Type":"ContainerDied","Data":"758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3"}
Oct 30 22:05:23.735174 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.735012    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4" event={"ID":"7f7721f4-0078-43e6-be9c-3250a4a3e250","Type":"ContainerDied","Data":"7eed55c17716eb20888c5b77262768809c36dbd17d24b7a42dd7016a58afa737"}
Oct 30 22:05:23.735174 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.735034    4943 scope.go:122] "RemoveContainer" containerID="758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3"
Oct 30 22:05:23.744175 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.744155    4943 scope.go:122] "RemoveContainer" containerID="758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3"
Oct 30 22:05:23.744437 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:05:23.744419    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3\": container with ID starting with 758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3 not found: ID does not exist" containerID="758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3"
Oct 30 22:05:23.744481 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.744445    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3"} err="failed to get container status \"758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3\": rpc error: code = NotFound desc = could not find container \"758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3\": container with ID starting with 758750a1dfbc8b17a25372de5df0169f2ec20cfc70c411b27b2cd3f1bae727c3 not found: ID does not exist"
Oct 30 22:05:23.897590 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.897545    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"]
Oct 30 22:05:23.946863 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:23.946834    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-nsqr4"]
Oct 30 22:05:25.616718 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:25.616687    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" path="/var/lib/kubelet/pods/7f7721f4-0078-43e6-be9c-3250a4a3e250/volumes"
Oct 30 22:05:48.313647 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.313609    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"]
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.313979    4943 cpu_manager.go:414] "containerMap: removing container" podUID="2d4b97c7-2e09-42a1-b01a-a739c91c36dc" containerName="maas-api"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.313990    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d4b97c7-2e09-42a1-b01a-a739c91c36dc" containerName="maas-api"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314002    4943 cpu_manager.go:414] "containerMap: removing container" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314007    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314019    4943 cpu_manager.go:414] "containerMap: removing container" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314025    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314058    4943 cpu_manager.go:414] "containerMap: removing container" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314064    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314070    4943 cpu_manager.go:414] "containerMap: removing container" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314075    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314081    4943 cpu_manager.go:414] "containerMap: removing container" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy"
Oct 30 22:05:48.314078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314085    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314096    4943 cpu_manager.go:414] "containerMap: removing container" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314100    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314107    4943 cpu_manager.go:414] "containerMap: removing container" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerName="manager"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314112    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerName="manager"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314120    4943 cpu_manager.go:414] "containerMap: removing container" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerName="manager"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314124    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerName="manager"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314131    4943 cpu_manager.go:414] "containerMap: removing container" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314136    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314142    4943 cpu_manager.go:414] "containerMap: removing container" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314147    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314239    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d4b97c7-2e09-42a1-b01a-a739c91c36dc" containerName="maas-api"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314250    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="45310248-a2aa-4851-ad39-7540074f1692" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314260    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="585b14ad-5aa4-4c2e-8b92-aa3eee706914" containerName="main"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314274    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="86b5b746-993c-4824-acdc-2e8c5b524329" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314290    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314299    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f7721f4-0078-43e6-be9c-3250a4a3e250" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314309    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="237d7c10-b29f-4629-9799-929f21401145" containerName="istio-proxy"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314320    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerName="manager"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314328    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="8092e5b2-176a-4a50-930e-b0d2cf4c20c3" containerName="main"
Oct 30 22:05:48.314796 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.314344    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="504172ff-ddd4-4772-8a1d-674ab6557357" containerName="istio-proxy"
Oct 30 22:05:48.319012 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.318995    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.342942 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.342912    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.342947    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b117fb6b-a40b-497b-a211-4507a59683e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.342967    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st48n\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-kube-api-access-st48n\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.343031    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343171 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.343111    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343171 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.343144    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b117fb6b-a40b-497b-a211-4507a59683e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343171 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.343164    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343291 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.343220    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.343291 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.343271    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.370916 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.370889    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-x8rmh\""
Oct 30 22:05:48.444428 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444401    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444444    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444471    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b117fb6b-a40b-497b-a211-4507a59683e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444501    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st48n\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-kube-api-access-st48n\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444575 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444537    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444774 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444581    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444774 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444642    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b117fb6b-a40b-497b-a211-4507a59683e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444774 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444677    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.444960 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444822    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.445017 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.444960    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.445071 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.445017    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.445115 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.445089    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.445186 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.445165    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.445414 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.445396    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b117fb6b-a40b-497b-a211-4507a59683e8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.446777 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.446756    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.447035 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.447016    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b117fb6b-a40b-497b-a211-4507a59683e8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.503416 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.503386    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st48n\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-kube-api-access-st48n\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.503539 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.503453    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-rjrrx\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:48.520445 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.520417    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"]
Oct 30 22:05:48.631463 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:48.631387    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:49.059868 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:49.059841    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"]
Oct 30 22:05:49.062961 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:05:49.062929    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb117fb6b_a40b_497b_a211_4507a59683e8.slice/crio-d1109a0dcd0cfaa26099fbb57d102c10b1a53a200df8b6573596ac43dedb5840 WatchSource:0}: Error finding container d1109a0dcd0cfaa26099fbb57d102c10b1a53a200df8b6573596ac43dedb5840: Status 404 returned error can't find the container with id d1109a0dcd0cfaa26099fbb57d102c10b1a53a200df8b6573596ac43dedb5840
Oct 30 22:05:49.065137 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:49.065104    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:05:49.065240 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:49.065165    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:05:49.065240 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:49.065198    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:05:49.875174 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:49.875136    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" event={"ID":"b117fb6b-a40b-497b-a211-4507a59683e8","Type":"ContainerStarted","Data":"6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2"}
Oct 30 22:05:49.875624 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:49.875187    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" event={"ID":"b117fb6b-a40b-497b-a211-4507a59683e8","Type":"ContainerStarted","Data":"d1109a0dcd0cfaa26099fbb57d102c10b1a53a200df8b6573596ac43dedb5840"}
Oct 30 22:05:49.992784 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:49.992704    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podStartSLOduration=1.992684182 podStartE2EDuration="1.992684182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:05:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:05:49.991686629 +0000 UTC m=+2944.487259980" watchObservedRunningTime="2026-10-30 22:05:49.992684182 +0000 UTC m=+2944.488257534"
Oct 30 22:05:50.631813 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:50.631778    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:50.633531 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:50.633505    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 22:05:50.633719 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:50.633578    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 22:05:50.667603 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:50.667121    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:51.086278 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:05:51.086243    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:05:51.631896 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:51.631865    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 22:05:51.632077 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:51.631941    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 22:05:52.632283 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:52.632249    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 22:05:52.632683 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:52.632313    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 22:05:52.824931 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:52.824895    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:05:53.632044 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:53.632006    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 22:05:53.632222 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:53.632066    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 22:05:54.632513 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:54.632477    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 22:05:54.633015 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:54.632533    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 22:05:55.632218 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:55.632180    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused" start-of-body=
Oct 30 22:05:55.632390 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:55.632246    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": dial tcp 10.132.0.125:15021: connect: connection refused"
Oct 30 22:05:57.284546 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:57.284510    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:57.285060 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:57.284945    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:05:57.285628 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:05:57.285608    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:06:02.939778 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:06:02.939741    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:06:21.062061 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:06:21.062018    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:06:46.144218 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:06:46.144178    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:06:46.154570 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:06:46.154536    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:06:51.062345 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:06:51.062304    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:06:53.190446 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:06:53.190411    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:18.382667 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.382585    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"]
Oct 30 22:07:18.383115 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.383101    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="8946ba66-fc18-4527-a27b-dd93cf55f850" containerName="manager"
Oct 30 22:07:18.386289 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.386270    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.470828 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.470797    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.470979 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.470840    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqm7r\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-kube-api-access-dqm7r\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.470979 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.470918    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.470979 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.470948    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.471142 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.471037    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.471142 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.471079    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.471220 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.471155    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.471220 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.471184    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.471220 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.471205    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572328 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572295    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572339    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqm7r\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-kube-api-access-dqm7r\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572357    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572463    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572733 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572526    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572733 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572576    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572733 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572644    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572733 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572672    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.572733 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572700    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.573000 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.572943    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.573059 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.573034    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.573120 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.573101    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.573184 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.573162    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.573363 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.573342    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.574930 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.574904    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.575056 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.575040    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.590437 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.590415    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"]
Oct 30 22:07:18.630285 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.630255    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.630425 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.630334    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqm7r\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-kube-api-access-dqm7r\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dtz5k\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:18.698480 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:18.698455    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:19.125583 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.125473    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"]
Oct 30 22:07:19.166826 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:07:19.166798    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9763f27b_1cdc_4372_a67e_e9cd17208e2a.slice/crio-aaac5502b325f6458582996057dd18e331354bc3c3c5a723bd388b344dcc3a67 WatchSource:0}: Error finding container aaac5502b325f6458582996057dd18e331354bc3c3c5a723bd388b344dcc3a67: Status 404 returned error can't find the container with id aaac5502b325f6458582996057dd18e331354bc3c3c5a723bd388b344dcc3a67
Oct 30 22:07:19.168935 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.168901    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:19.169043 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.168982    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:19.169043 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.169027    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:19.342967 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.342931    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" event={"ID":"9763f27b-1cdc-4372-a67e-e9cd17208e2a","Type":"ContainerStarted","Data":"ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e"}
Oct 30 22:07:19.343141 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.342984    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" event={"ID":"9763f27b-1cdc-4372-a67e-e9cd17208e2a","Type":"ContainerStarted","Data":"aaac5502b325f6458582996057dd18e331354bc3c3c5a723bd388b344dcc3a67"}
Oct 30 22:07:19.460026 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.459965    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podStartSLOduration=1.459949412 podStartE2EDuration="1.459949412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:19.458530143 +0000 UTC m=+3033.954103496" watchObservedRunningTime="2026-10-30 22:07:19.459949412 +0000 UTC m=+3033.955522754"
Oct 30 22:07:19.699445 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:19.699406    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:20.701003 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:20.700970    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 22:07:20.701385 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:20.701033    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 22:07:21.089802 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:07:21.089709    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:07:21.698907 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:21.698873    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 22:07:21.699100 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:21.698928    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 22:07:22.699326 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:22.699288    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 22:07:22.699730 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:22.699360    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 22:07:23.699767 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:23.699729    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 22:07:23.700166 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:23.699779    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 22:07:24.699701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:24.699667    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 22:07:24.699875 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:24.699720    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 22:07:24.783491 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:24.783453    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:07:25.699798 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:25.699761    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dtz5k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused" start-of-body=
Oct 30 22:07:25.700017 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:25.699815    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.126:15021/healthz/ready\": dial tcp 10.132.0.126:15021: connect: connection refused"
Oct 30 22:07:27.464536 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:27.464502    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:27.465075 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:27.464863    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:27.465627 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:27.465605    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:07:33.368170 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.368090    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"]
Oct 30 22:07:33.372153 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.372128    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421323 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421285    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421470 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421334    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421520 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421474    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421520 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421513    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421663 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421539    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421707 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421675    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fac9883-4c89-47e4-aabc-30e1c220b302-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421755 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421720    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v46z\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-kube-api-access-9v46z\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421827 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421804    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.421902 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.421889    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.476610 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.476573    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"]
Oct 30 22:07:33.523096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523064    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523099    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523339 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523125    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523339 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523159    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fac9883-4c89-47e4-aabc-30e1c220b302-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523339 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523205    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v46z\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-kube-api-access-9v46z\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523339 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523256    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523339 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523287    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523339 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523327    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523654 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523386    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.523875 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.523832    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-credential-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.524029 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.524004    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-data\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.524029 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.524015    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fac9883-4c89-47e4-aabc-30e1c220b302-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.524158 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.524079    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-socket\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.524206 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.524166    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-certs\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.525822 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.525801    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-envoy\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.526135 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.526115    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.580279 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.580255    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-token\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.580423 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.580401    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v46z\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-kube-api-access-9v46z\") pod \"maas-default-gateway-openshift-default-7f694df8bc-dqh7x\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:33.685811 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:33.685779    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:34.118068 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.118031    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"]
Oct 30 22:07:34.120583 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:07:34.120538    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fac9883_4c89_47e4_aabc_30e1c220b302.slice/crio-686bc5ae7a47293d409a6567834bc6c04c4934665548668ca032f5dc62229253 WatchSource:0}: Error finding container 686bc5ae7a47293d409a6567834bc6c04c4934665548668ca032f5dc62229253: Status 404 returned error can't find the container with id 686bc5ae7a47293d409a6567834bc6c04c4934665548668ca032f5dc62229253
Oct 30 22:07:34.122846 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.122815    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:34.122931 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.122878    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:34.122931 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.122907    4943 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 30 22:07:34.453720 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.453678    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" event={"ID":"9fac9883-4c89-47e4-aabc-30e1c220b302","Type":"ContainerStarted","Data":"72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0"}
Oct 30 22:07:34.454208 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.453739    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" event={"ID":"9fac9883-4c89-47e4-aabc-30e1c220b302","Type":"ContainerStarted","Data":"686bc5ae7a47293d409a6567834bc6c04c4934665548668ca032f5dc62229253"}
Oct 30 22:07:34.571845 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.571787    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podStartSLOduration=1.571767642 podStartE2EDuration="1.571767642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:07:34.570414755 +0000 UTC m=+3049.065988106" watchObservedRunningTime="2026-10-30 22:07:34.571767642 +0000 UTC m=+3049.067340994"
Oct 30 22:07:34.686147 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:34.686111    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:35.688427 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:35.688390    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 22:07:35.688869 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:35.688456    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 22:07:36.686314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:36.686279    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 22:07:36.686506 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:36.686335    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 22:07:37.686750 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:37.686708    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 22:07:37.687290 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:37.686763    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 22:07:38.687142 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:38.687106    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 22:07:38.687539 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:38.687174    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 22:07:39.686875 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:39.686835    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 22:07:39.687066 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:39.686896    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 22:07:40.686318 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:40.686280    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-dqh7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused" start-of-body=
Oct 30 22:07:40.686715 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:40.686385    4943 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.127:15021/healthz/ready\": dial tcp 10.132.0.127:15021: connect: connection refused"
Oct 30 22:07:42.354217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:42.354169    4943 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:42.354693 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:42.354582    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:42.355530 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:42.355509    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:07:51.066194 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:07:51.066149    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:07:53.539742 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:07:53.539699    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:03.681146 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:08:03.681070    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:03.860422 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:08:03.860391    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:21.061727 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:08:21.061689    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:08:51.061749 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:08:51.061706    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:08:53.870238 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:08:53.870197    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:08:58.331752 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:08:58.331703    4943 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7f694df8bc-rjrrx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.125:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 30 22:08:58.332254 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:08:58.331785    4943 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.125:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 30 22:09:21.062520 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:09:21.062483    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:09:51.062197 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:09:51.062155    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:09:55.555893 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:09:55.555859    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:21.063634 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:10:21.063591    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:10:51.062314 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:10:51.062279    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:10:52.619378 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:10:52.619342    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:10:54.544473 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:10:54.544436    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:11.410280 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:11:11.410243    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:11:21.062452 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:11:21.062411    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:11:46.208356 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:11:46.208322    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:11:46.211062 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:11:46.211030    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:11:51.062832 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:11:51.062797    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:11:54.875203 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:11:54.875146    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:21.063234 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:12:21.063195    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:12:34.275454 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:12:34.275418    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:51.062321 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:12:51.062274    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:12:53.762485 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:12:53.762452    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:54.556827 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:12:54.556798    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:12:55.226788 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:12:55.226755    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:05.402418 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:05.402337    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:16.016078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:16.016033    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:16.207754 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:16.207714    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.013850 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:21.013807    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.062072 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:13:21.062034    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:13:21.206941 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:21.206899    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:21.401251 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:21.401220    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:24.224774 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:24.224738    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:24.410030 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:24.409998    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:27.378494 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:27.378446    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:27.556053 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:27.556005    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:27.733986 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:27.733957    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:32.254223 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:32.254184    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:37.184462 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:37.184429    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:42.132650 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:42.132603    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:45.944759 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:45.944723    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:46.631055 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:46.631022    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:47.016412 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:47.016374    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:47.448064 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:47.448031    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:49.485142 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:49.485110    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:51.062532 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:13:51.062497    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:13:52.345873 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:52.340676    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:55.656315 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:55.656276    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:13:57.298316 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:13:57.298279    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:02.045997 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:02.045959    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:06.864841 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:06.864795    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:11.722173 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:11.722106    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:16.444602 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:16.444536    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:21.062386 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:14:21.062351    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:14:21.143925 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:21.143872    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:25.942605 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:25.942542    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:30.718866 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:30.718753    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:35.530049 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:35.529980    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:40.378314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:40.378277    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:45.212481 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:45.212398    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:50.033021 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:50.032967    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:51.062030 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:14:51.061997    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:14:54.955241 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:54.955136    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:55.899568 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:55.899464    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:14:59.696377 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:14:59.696341    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:00.164754 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.164725    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"]
Oct 30 22:15:00.168343 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.168325    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.244543 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.244507    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b64119-ed68-4b8b-8897-32a5ff50b2e6-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-gp2p5\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.244679 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.244550    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fndxp\" (UniqueName: \"kubernetes.io/projected/24b64119-ed68-4b8b-8897-32a5ff50b2e6-kube-api-access-fndxp\") pod \"maas-api-key-cleanup-29889975-gp2p5\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.263191 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.263164    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"]
Oct 30 22:15:00.316526 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.316500    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:15:00.335320 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.335298    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:15:00.335320 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.335297    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6t2c7\""
Oct 30 22:15:00.345045 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.345023    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b64119-ed68-4b8b-8897-32a5ff50b2e6-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-gp2p5\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.345130 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.345060    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fndxp\" (UniqueName: \"kubernetes.io/projected/24b64119-ed68-4b8b-8897-32a5ff50b2e6-kube-api-access-fndxp\") pod \"maas-api-key-cleanup-29889975-gp2p5\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.345652 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.345635    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b64119-ed68-4b8b-8897-32a5ff50b2e6-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889975-gp2p5\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.402773 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.402744    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fndxp\" (UniqueName: \"kubernetes.io/projected/24b64119-ed68-4b8b-8897-32a5ff50b2e6-kube-api-access-fndxp\") pod \"maas-api-key-cleanup-29889975-gp2p5\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.481375 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.481308    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:00.856788 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:00.856763    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"]
Oct 30 22:15:00.859009 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:15:00.858982    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b64119_ed68_4b8b_8897_32a5ff50b2e6.slice/crio-0a5d0daba6e65390573e9d030d8cf998ec643b6ff709ed163c5aa142d185b60b WatchSource:0}: Error finding container 0a5d0daba6e65390573e9d030d8cf998ec643b6ff709ed163c5aa142d185b60b: Status 404 returned error can't find the container with id 0a5d0daba6e65390573e9d030d8cf998ec643b6ff709ed163c5aa142d185b60b
Oct 30 22:15:01.102789 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:01.102751    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" event={"ID":"24b64119-ed68-4b8b-8897-32a5ff50b2e6","Type":"ContainerStarted","Data":"0a5d0daba6e65390573e9d030d8cf998ec643b6ff709ed163c5aa142d185b60b"}
Oct 30 22:15:02.109700 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:02.109664    4943 generic.go:356] "Generic (PLEG): container finished" podID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerID="42fba00b0b0fb91d4fc787baaf2051cd5b616305b9c89f91288a5c721d8db328" exitCode=60
Oct 30 22:15:02.110163 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:02.109747    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" event={"ID":"24b64119-ed68-4b8b-8897-32a5ff50b2e6","Type":"ContainerDied","Data":"42fba00b0b0fb91d4fc787baaf2051cd5b616305b9c89f91288a5c721d8db328"}
Oct 30 22:15:02.110163 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:02.109995    4943 scope.go:122] "RemoveContainer" containerID="42fba00b0b0fb91d4fc787baaf2051cd5b616305b9c89f91288a5c721d8db328"
Oct 30 22:15:03.120378 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:03.120348    4943 generic.go:356] "Generic (PLEG): container finished" podID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerID="62675974dc318a7b3bbb5edd911e94f0a931e3a5801594eb0e2fdf0b7e6c6d5e" exitCode=60
Oct 30 22:15:03.120813 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:03.120394    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" event={"ID":"24b64119-ed68-4b8b-8897-32a5ff50b2e6","Type":"ContainerDied","Data":"62675974dc318a7b3bbb5edd911e94f0a931e3a5801594eb0e2fdf0b7e6c6d5e"}
Oct 30 22:15:03.120813 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:03.120440    4943 scope.go:122] "RemoveContainer" containerID="42fba00b0b0fb91d4fc787baaf2051cd5b616305b9c89f91288a5c721d8db328"
Oct 30 22:15:03.120813 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:03.120680    4943 scope.go:122] "RemoveContainer" containerID="62675974dc318a7b3bbb5edd911e94f0a931e3a5801594eb0e2fdf0b7e6c6d5e"
Oct 30 22:15:03.120941 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:15:03.120918    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-gp2p5_odh-ai-gateway-infra(24b64119-ed68-4b8b-8897-32a5ff50b2e6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6"
Oct 30 22:15:04.127681 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:04.127656    4943 scope.go:122] "RemoveContainer" containerID="62675974dc318a7b3bbb5edd911e94f0a931e3a5801594eb0e2fdf0b7e6c6d5e"
Oct 30 22:15:04.128039 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:15:04.127861    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-gp2p5_odh-ai-gateway-infra(24b64119-ed68-4b8b-8897-32a5ff50b2e6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6"
Oct 30 22:15:04.828078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:04.828031    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:05.005217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:05.005168    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:05.748845 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:05.748810    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:06.117801 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:06.117708    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:10.032110 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:10.032058    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:11.145973 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:11.145932    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:14.611510 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:14.611476    4943 scope.go:122] "RemoveContainer" containerID="62675974dc318a7b3bbb5edd911e94f0a931e3a5801594eb0e2fdf0b7e6c6d5e"
Oct 30 22:15:15.034577 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:15.034496    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:15.201270 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:15.201180    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" event={"ID":"24b64119-ed68-4b8b-8897-32a5ff50b2e6","Type":"ContainerStarted","Data":"497e712ed8a8e101ecd9c21f088f3502490b31ee48927c06edf064eda82c0ae3"}
Oct 30 22:15:15.316851 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:15.316762    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" podStartSLOduration=15.316747537 podStartE2EDuration="15.316747537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:15:15.313748044 +0000 UTC m=+3509.809321395" watchObservedRunningTime="2026-10-30 22:15:15.316747537 +0000 UTC m=+3509.812320885"
Oct 30 22:15:16.209390 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:16.209358    4943 generic.go:356] "Generic (PLEG): container finished" podID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerID="497e712ed8a8e101ecd9c21f088f3502490b31ee48927c06edf064eda82c0ae3" exitCode=60
Oct 30 22:15:16.209850 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:16.209430    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" event={"ID":"24b64119-ed68-4b8b-8897-32a5ff50b2e6","Type":"ContainerDied","Data":"497e712ed8a8e101ecd9c21f088f3502490b31ee48927c06edf064eda82c0ae3"}
Oct 30 22:15:16.209850 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:16.209488    4943 scope.go:122] "RemoveContainer" containerID="62675974dc318a7b3bbb5edd911e94f0a931e3a5801594eb0e2fdf0b7e6c6d5e"
Oct 30 22:15:16.209850 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:16.209824    4943 scope.go:122] "RemoveContainer" containerID="497e712ed8a8e101ecd9c21f088f3502490b31ee48927c06edf064eda82c0ae3"
Oct 30 22:15:16.210066 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:15:16.210048    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889975-gp2p5_odh-ai-gateway-infra(24b64119-ed68-4b8b-8897-32a5ff50b2e6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6"
Oct 30 22:15:16.325894 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:16.325864    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"]
Oct 30 22:15:17.364066 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:17.364036    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:17.519533 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:17.519455    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/24b64119-ed68-4b8b-8897-32a5ff50b2e6-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b64119-ed68-4b8b-8897-32a5ff50b2e6-maas-api-service-ca\") pod \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") "
Oct 30 22:15:17.519533 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:17.519519    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/24b64119-ed68-4b8b-8897-32a5ff50b2e6-kube-api-access-fndxp\" (UniqueName: \"kubernetes.io/projected/24b64119-ed68-4b8b-8897-32a5ff50b2e6-kube-api-access-fndxp\") pod \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\" (UID: \"24b64119-ed68-4b8b-8897-32a5ff50b2e6\") "
Oct 30 22:15:17.519841 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:17.519818    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24b64119-ed68-4b8b-8897-32a5ff50b2e6-maas-api-service-ca" pod "24b64119-ed68-4b8b-8897-32a5ff50b2e6" (UID: "24b64119-ed68-4b8b-8897-32a5ff50b2e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:15:17.521649 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:17.521619    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24b64119-ed68-4b8b-8897-32a5ff50b2e6-kube-api-access-fndxp" pod "24b64119-ed68-4b8b-8897-32a5ff50b2e6" (UID: "24b64119-ed68-4b8b-8897-32a5ff50b2e6"). InnerVolumeSpecName "kube-api-access-fndxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:17.620517 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:17.620490    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24b64119-ed68-4b8b-8897-32a5ff50b2e6-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:17.620517 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:17.620515    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fndxp\" (UniqueName: \"kubernetes.io/projected/24b64119-ed68-4b8b-8897-32a5ff50b2e6-kube-api-access-fndxp\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:18.224080 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:18.224047    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"
Oct 30 22:15:18.224080 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:18.224069    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5" event={"ID":"24b64119-ed68-4b8b-8897-32a5ff50b2e6","Type":"ContainerDied","Data":"0a5d0daba6e65390573e9d030d8cf998ec643b6ff709ed163c5aa142d185b60b"}
Oct 30 22:15:18.224342 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:18.224135    4943 scope.go:122] "RemoveContainer" containerID="497e712ed8a8e101ecd9c21f088f3502490b31ee48927c06edf064eda82c0ae3"
Oct 30 22:15:18.387217 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:18.387184    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"]
Oct 30 22:15:18.392025 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:18.391999    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889975-gp2p5"]
Oct 30 22:15:18.498423 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:18.498268    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:18.694811 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:18.694772    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:19.617006 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:19.616966    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" path="/var/lib/kubelet/pods/24b64119-ed68-4b8b-8897-32a5ff50b2e6/volumes"
Oct 30 22:15:19.864787 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:19.864712    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:21.062543 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:15:21.062507    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:15:24.061458 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:24.061427    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:25.607568 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:25.607523    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:25.884706 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:25.884614    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:26.691183 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:26.691143    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:32.617398 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:32.617359    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:32.828890 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:32.828858    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:33.078332 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:33.078299    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:48.422898 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:48.422860    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:48.978457 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:48.978424    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:51.062736 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:15:51.062692    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:15:54.555017 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:54.554976    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:56.237539 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:56.237507    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:15:56.714004 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:56.713963    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"]
Oct 30 22:15:56.714260 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:56.714234    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2" podUID="0472298e-497f-4cfc-8226-cef5d5341ec2" containerName="manager" containerID="cri-o://3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53" gracePeriod=10
Oct 30 22:15:56.967100 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:56.967039    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 22:15:57.101465 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.101435    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0472298e-497f-4cfc-8226-cef5d5341ec2-kube-api-access-ldg62\" (UniqueName: \"kubernetes.io/projected/0472298e-497f-4cfc-8226-cef5d5341ec2-kube-api-access-ldg62\") pod \"0472298e-497f-4cfc-8226-cef5d5341ec2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") "
Oct 30 22:15:57.101645 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.101496    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0472298e-497f-4cfc-8226-cef5d5341ec2-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472298e-497f-4cfc-8226-cef5d5341ec2-extensions-socket-volume\") pod \"0472298e-497f-4cfc-8226-cef5d5341ec2\" (UID: \"0472298e-497f-4cfc-8226-cef5d5341ec2\") "
Oct 30 22:15:57.102078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.102015    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0472298e-497f-4cfc-8226-cef5d5341ec2-extensions-socket-volume" pod "0472298e-497f-4cfc-8226-cef5d5341ec2" (UID: "0472298e-497f-4cfc-8226-cef5d5341ec2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:15:57.103999 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.103969    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0472298e-497f-4cfc-8226-cef5d5341ec2-kube-api-access-ldg62" pod "0472298e-497f-4cfc-8226-cef5d5341ec2" (UID: "0472298e-497f-4cfc-8226-cef5d5341ec2"). InnerVolumeSpecName "kube-api-access-ldg62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:15:57.203278 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.203241    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldg62\" (UniqueName: \"kubernetes.io/projected/0472298e-497f-4cfc-8226-cef5d5341ec2-kube-api-access-ldg62\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:57.203278 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.203273    4943 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0472298e-497f-4cfc-8226-cef5d5341ec2-extensions-socket-volume\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:15:57.442067 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.442032    4943 generic.go:356] "Generic (PLEG): container finished" podID="0472298e-497f-4cfc-8226-cef5d5341ec2" containerID="3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53" exitCode=0
Oct 30 22:15:57.442497 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.442076    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2" event={"ID":"0472298e-497f-4cfc-8226-cef5d5341ec2","Type":"ContainerDied","Data":"3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53"}
Oct 30 22:15:57.442497 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.442082    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"
Oct 30 22:15:57.442497 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.442135    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2" event={"ID":"0472298e-497f-4cfc-8226-cef5d5341ec2","Type":"ContainerDied","Data":"7ea882390decb34218014f10632bde76ca32b9be7fd961886e6a47da1ac5d76b"}
Oct 30 22:15:57.442497 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.442166    4943 scope.go:122] "RemoveContainer" containerID="3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53"
Oct 30 22:15:57.454777 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.454756    4943 scope.go:122] "RemoveContainer" containerID="3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53"
Oct 30 22:15:57.456484 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:15:57.456457    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53\": container with ID starting with 3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53 not found: ID does not exist" containerID="3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53"
Oct 30 22:15:57.456626 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.456496    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53"} err="failed to get container status \"3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53\": rpc error: code = NotFound desc = could not find container \"3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53\": container with ID starting with 3ea2630df4c24c89f4d1126c3e973e4543c2cb4720f76de73bc92c4cdef5fc53 not found: ID does not exist"
Oct 30 22:15:57.605107 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.605076    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"]
Oct 30 22:15:57.654975 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:57.654938    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-lrvx2"]
Oct 30 22:15:59.617029 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:15:59.616995    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0472298e-497f-4cfc-8226-cef5d5341ec2" path="/var/lib/kubelet/pods/0472298e-497f-4cfc-8226-cef5d5341ec2/volumes"
Oct 30 22:16:21.063483 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:16:21.063446    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:16:46.248870 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:16:46.248843    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:16:46.259277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:16:46.259249    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:16:51.062069 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:16:51.062026    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:16:56.578031 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:16:56.577997    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:21.062073 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:17:21.062033    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:17:51.064411 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:17:51.064377    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:17:56.839814 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:17:56.839768    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:17:57.010222 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:17:57.010195    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:21.061452 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:18:21.061415    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:18:37.413064 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:18:37.413030    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:48.035594 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:18:48.035528    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:48.345727 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:18:48.345639    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:18:51.063015 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:18:51.062967    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:18:57.255109 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:18:57.255025    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:10.810969 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:10.810927    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:11.034400 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:11.034364    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:14.167675 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:14.167635    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:14.461525 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:14.461445    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:17.151389 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:17.151355    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:17.403596 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:17.403482    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:21.062708 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:19:21.062675    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:19:22.140596 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:22.140492    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:27.207278 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:27.207244    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:31.955323 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:31.955268    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:35.430968 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:35.430910    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:36.114630 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:36.114599    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:36.315697 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:36.315663    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:37.080643 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:37.076354    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:41.996709 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:41.996671    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:44.123727 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:44.123693    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:46.209810 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:46.209770    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:46.842715 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:46.842663    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:49.003478 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:49.003268    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:51.062286 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:19:51.062252    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:19:51.748589 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:51.748518    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:56.649666 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:56.649626    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:19:57.693494 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:19:57.693455    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:01.576016 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:01.575983    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:06.607210 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:06.607173    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:11.552949 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:11.552910    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:16.551713 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:16.551671    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:20.177928 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:20.177867    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:20.368445 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:20.368413    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:21.062716 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:20:21.062686    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:20:21.344663 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:21.343126    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:26.243701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:26.243622    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:31.134694 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:31.134466    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:35.945330 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:35.945292    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:40.759007 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:40.758738    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:45.550515 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:45.550452    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:50.294666 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:50.294628    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:51.062255 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:20:51.062215    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:20:55.290355 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:55.290306    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:57.604142 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:57.604084    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:20:57.915580 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:20:57.915528    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:00.231814 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:00.231782    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:02.853719 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:02.853684    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:05.165085 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:05.165048    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:09.930775 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:09.930738    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:10.119988 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:10.119950    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:14.144382 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:14.144343    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:15.688010 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:15.687977    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:15.954696 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:15.954621    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:16.742406 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:16.742375    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:21.061543 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:21:21.061505    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:21:22.770851 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:22.770797    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:22.994916 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:22.994862    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:23.272013 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:23.271980    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:29.670041 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:29.669642    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:39.563313 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:39.563260    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:40.317570 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:40.317527    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:46.294961 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:46.294931    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:21:46.300333 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:46.300307    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:21:51.062458 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:21:51.062423    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:21:54.285889 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:54.285854    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:21:58.242502 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:21:58.242410    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:11.930734 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:22:11.930672    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:22:21.061719 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:22:21.061683    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:22:51.128070 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:22:51.128030    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:22:58.585773 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:22:58.585734    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:09.868140 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:23:09.868108    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:21.062714 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:23:21.062675    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:23:25.979787 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:23:25.979753    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:30.771252 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:23:30.771092    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:30.941642 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:23:30.941528    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:37.299090 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:23:37.299033    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:38.169139 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:23:38.169101    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:23:51.079035 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:23:51.078999    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:23:58.923316 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:23:58.923282    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:17.074239 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:17.074203    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:17.259008 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:17.258974    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:21.063456 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:24:21.063419    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:24:32.828168 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:32.828136    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:33.445444 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:33.445412    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:33.652855 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:33.652828    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:47.387582 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:47.386420    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:47.671987 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:47.671935    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:50.310140 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:50.310108    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:50.512809 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:50.512775    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:51.062133 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:24:51.062093    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:24:51.772781 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:51.772744    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:51.952067 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:51.952038    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:52.136635 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:52.134884    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:56.651924 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:56.651797    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:24:59.273162 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:24:59.273129    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:01.476665 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:01.471428    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:06.234464 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:06.234429    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:11.361017 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:11.360933    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:11.772848 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:11.772818    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:11.945658 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:11.945628    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:16.146981 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:16.146944    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:20.916274 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:20.916236    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:21.062754 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:25:21.062721    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:25:25.943106 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:25.943065    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:28.578756 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:28.578716    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:28.748326 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:28.748294    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:30.925928 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:30.925885    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:33.559280 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559244    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"]
Oct 30 22:25:33.559701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559648    4943 cpu_manager.go:414] "containerMap: removing container" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:25:33.559701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559659    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:25:33.559701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559672    4943 cpu_manager.go:414] "containerMap: removing container" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:25:33.559701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559677    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:25:33.559701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559686    4943 cpu_manager.go:414] "containerMap: removing container" podUID="0472298e-497f-4cfc-8226-cef5d5341ec2" containerName="manager"
Oct 30 22:25:33.559701 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559691    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0472298e-497f-4cfc-8226-cef5d5341ec2" containerName="manager"
Oct 30 22:25:33.559897 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559751    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:25:33.559897 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559759    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="0472298e-497f-4cfc-8226-cef5d5341ec2" containerName="manager"
Oct 30 22:25:33.559897 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.559768    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:25:33.562681 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.562665    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.659029 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.658996    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.659183 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.659064    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.659183 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.659148    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw84g\" (UniqueName: \"kubernetes.io/projected/eaa68193-5587-47ac-a661-6c6fdf6e47cd-kube-api-access-pw84g\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.665690 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.665666    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:25:33.665817 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.665696    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:25:33.665817 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.665698    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vq9dr\""
Oct 30 22:25:33.665817 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.665731    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:25:33.668340 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.668317    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"]
Oct 30 22:25:33.760386 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.760356    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.760530 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.760396    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw84g\" (UniqueName: \"kubernetes.io/projected/eaa68193-5587-47ac-a661-6c6fdf6e47cd-kube-api-access-pw84g\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.760530 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.760434    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.760995 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.760973    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.762705 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.762688    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.817548 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.817494    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw84g\" (UniqueName: \"kubernetes.io/projected/eaa68193-5587-47ac-a661-6c6fdf6e47cd-kube-api-access-pw84g\") pod \"maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:33.875427 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:33.875405    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:34.250091 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:34.250059    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"]
Oct 30 22:25:34.252007 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:25:34.251981    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa68193_5587_47ac_a661_6c6fdf6e47cd.slice/crio-c2062f290bf0373f7bcf61d86a9c922c3cb1b1c71d472597217950fb17d15995 WatchSource:0}: Error finding container c2062f290bf0373f7bcf61d86a9c922c3cb1b1c71d472597217950fb17d15995: Status 404 returned error can't find the container with id c2062f290bf0373f7bcf61d86a9c922c3cb1b1c71d472597217950fb17d15995
Oct 30 22:25:34.731959 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:34.731921    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c" event={"ID":"eaa68193-5587-47ac-a661-6c6fdf6e47cd","Type":"ContainerStarted","Data":"43e2397bbb3c8fdf3dc00e42b57a10085201c5d122ab986fad0af73d6cf24915"}
Oct 30 22:25:34.732407 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:34.731977    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c" event={"ID":"eaa68193-5587-47ac-a661-6c6fdf6e47cd","Type":"ContainerStarted","Data":"c2062f290bf0373f7bcf61d86a9c922c3cb1b1c71d472597217950fb17d15995"}
Oct 30 22:25:34.845499 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:34.845401    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c" podStartSLOduration=1.8453858159999998 podStartE2EDuration="1.845385816s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:25:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:25:34.844445979 +0000 UTC m=+4129.340019330" watchObservedRunningTime="2026-10-30 22:25:34.845385816 +0000 UTC m=+4129.340959167"
Oct 30 22:25:35.728894 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:35.728849    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:35.763637 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:35.763606    4943 generic.go:356] "Generic (PLEG): container finished" podID="eaa68193-5587-47ac-a661-6c6fdf6e47cd" containerID="43e2397bbb3c8fdf3dc00e42b57a10085201c5d122ab986fad0af73d6cf24915" exitCode=0
Oct 30 22:25:35.764086 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:35.763684    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c" event={"ID":"eaa68193-5587-47ac-a661-6c6fdf6e47cd","Type":"ContainerDied","Data":"43e2397bbb3c8fdf3dc00e42b57a10085201c5d122ab986fad0af73d6cf24915"}
Oct 30 22:25:36.904051 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:36.904029    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:36.994838 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:36.994802    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eaa68193-5587-47ac-a661-6c6fdf6e47cd-kube-api-access-pw84g\" (UniqueName: \"kubernetes.io/projected/eaa68193-5587-47ac-a661-6c6fdf6e47cd-kube-api-access-pw84g\") pod \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") "
Oct 30 22:25:36.995011 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:36.994972    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-openshift-ca\") pod \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") "
Oct 30 22:25:36.995054 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:36.995017    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-xks-ca\") pod \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\" (UID: \"eaa68193-5587-47ac-a661-6c6fdf6e47cd\") "
Oct 30 22:25:36.995358 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:36.995336    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-openshift-ca" pod "eaa68193-5587-47ac-a661-6c6fdf6e47cd" (UID: "eaa68193-5587-47ac-a661-6c6fdf6e47cd"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:25:36.997033 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:36.997010    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa68193-5587-47ac-a661-6c6fdf6e47cd-kube-api-access-pw84g" pod "eaa68193-5587-47ac-a661-6c6fdf6e47cd" (UID: "eaa68193-5587-47ac-a661-6c6fdf6e47cd"). InnerVolumeSpecName "kube-api-access-pw84g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:25:36.997137 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:36.997094    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-xks-ca" pod "eaa68193-5587-47ac-a661-6c6fdf6e47cd" (UID: "eaa68193-5587-47ac-a661-6c6fdf6e47cd"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:25:37.096731 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:37.096660    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-xks-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:37.096731 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:37.096688    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw84g\" (UniqueName: \"kubernetes.io/projected/eaa68193-5587-47ac-a661-6c6fdf6e47cd-kube-api-access-pw84g\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:37.096731 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:37.096699    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa68193-5587-47ac-a661-6c6fdf6e47cd-maas-api-openshift-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:25:37.775732 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:37.775704    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"
Oct 30 22:25:37.775930 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:37.775744    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c" event={"ID":"eaa68193-5587-47ac-a661-6c6fdf6e47cd","Type":"ContainerDied","Data":"c2062f290bf0373f7bcf61d86a9c922c3cb1b1c71d472597217950fb17d15995"}
Oct 30 22:25:37.775930 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:37.775790    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2062f290bf0373f7bcf61d86a9c922c3cb1b1c71d472597217950fb17d15995"
Oct 30 22:25:40.518232 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:40.518202    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:45.224161 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:45.224124    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:45.456752 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:45.456718    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:45.634572 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:45.634466    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:49.385826 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:49.385777    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:50.894278 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:50.894237    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:51.061931 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:25:51.061898    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:25:51.177195 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:51.177132    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:51.343436 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:51.343398    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"]
Oct 30 22:25:51.392719 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:51.392688    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-daf0fd7e-btf4c"]
Oct 30 22:25:51.616775 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:51.616703    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eaa68193-5587-47ac-a661-6c6fdf6e47cd" path="/var/lib/kubelet/pods/eaa68193-5587-47ac-a661-6c6fdf6e47cd/volumes"
Oct 30 22:25:54.704591 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:54.704543    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:25:59.587838 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:25:59.587803    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:05.992417 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:05.992382    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:06.629085 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:06.629046    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:06.850741 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:06.850710    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:11.207412 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:11.207375    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:11.404707 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:11.404674    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:11.686125 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:11.686087    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:14.507110 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:14.507079    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:14.687026 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:14.686994    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:17.393950 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:17.393906    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:17.579057 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:17.570843    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:17.747387 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:17.747348    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:21.061391 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:26:21.061361    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:26:22.253579 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:22.246630    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:27.188918 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:27.188823    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:28.336323 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:28.336287    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:31.948686 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:31.948580    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:37.065824 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:37.065764    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:41.857787 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:41.857739    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:46.044198 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:46.044149    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:46.337169 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:46.337087    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:26:46.343527 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:46.343505    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:26:46.636451 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:46.636365    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:51.062797 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:26:51.062761    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:26:51.410752 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:51.410720    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:56.237009 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:56.236971    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:26:59.928644 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:26:59.928606    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:00.945993 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:00.945954    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:04.115145 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:04.115110    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:04.821276 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:04.821244    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:05.751242 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:05.751195    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:10.460232 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:10.460196    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:15.228522 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:15.228485    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:19.886609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:19.886567    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:21.061402 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:27:21.061364    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:27:24.725396 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:24.725359    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:29.448580 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:29.444787    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:34.283933 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:34.283896    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:38.934657 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:38.934622    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:43.745602 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:43.745537    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:48.549420 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:48.549270    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:51.062724 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:27:51.062679    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:27:53.338837 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:53.338759    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:27:58.035452 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:27:58.033893    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:00.314921 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:00.314888    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:02.826348 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:02.826309    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:07.553996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:07.553955    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:12.332734 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:12.332693    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:17.065043 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.065003    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:17.090692 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.090653    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"]
Oct 30 22:28:17.091161 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.091142    4943 cpu_manager.go:414] "containerMap: removing container" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:28:17.091161 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.091162    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:28:17.091303 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.091180    4943 cpu_manager.go:414] "containerMap: removing container" podUID="eaa68193-5587-47ac-a661-6c6fdf6e47cd" containerName="revoke-keys"
Oct 30 22:28:17.091303 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.091185    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eaa68193-5587-47ac-a661-6c6fdf6e47cd" containerName="revoke-keys"
Oct 30 22:28:17.091303 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.091269    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="24b64119-ed68-4b8b-8897-32a5ff50b2e6" containerName="cleanup"
Oct 30 22:28:17.091303 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.091285    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="eaa68193-5587-47ac-a661-6c6fdf6e47cd" containerName="revoke-keys"
Oct 30 22:28:17.094594 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.094575    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.116865 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.116842    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfv9k\" (UniqueName: \"kubernetes.io/projected/f54dadd3-7c07-4eea-919c-1910ad1d6d66-kube-api-access-hfv9k\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.116987 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.116952    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.117036 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.116997    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.146643 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.146617    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:28:17.146761 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.146701    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:28:17.146892 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.146874    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:28:17.147009 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.146993    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vq9dr\""
Oct 30 22:28:17.198521 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.198478    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"]
Oct 30 22:28:17.217792 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.217764    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.217941 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.217803    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.218002 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.217932    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfv9k\" (UniqueName: \"kubernetes.io/projected/f54dadd3-7c07-4eea-919c-1910ad1d6d66-kube-api-access-hfv9k\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.218485 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.218463    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.220314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.220287    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.274260 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.274237    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfv9k\" (UniqueName: \"kubernetes.io/projected/f54dadd3-7c07-4eea-919c-1910ad1d6d66-kube-api-access-hfv9k\") pod \"maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.407093 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.407055    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:17.779078 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:17.779053    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"]
Oct 30 22:28:17.781374 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:28:17.781345    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54dadd3_7c07_4eea_919c_1910ad1d6d66.slice/crio-0d64f131100eb1fb2b7cc649364ad910e30a896e517bb373e8ba4729789ebe14 WatchSource:0}: Error finding container 0d64f131100eb1fb2b7cc649364ad910e30a896e517bb373e8ba4729789ebe14: Status 404 returned error can't find the container with id 0d64f131100eb1fb2b7cc649364ad910e30a896e517bb373e8ba4729789ebe14
Oct 30 22:28:18.670027 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:18.669998    4943 generic.go:356] "Generic (PLEG): container finished" podID="f54dadd3-7c07-4eea-919c-1910ad1d6d66" containerID="982ab6887d084b5a20949eae196843051865a30c8a3b33feea9b6ad369ae03ee" exitCode=0
Oct 30 22:28:18.670356 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:18.670073    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg" event={"ID":"f54dadd3-7c07-4eea-919c-1910ad1d6d66","Type":"ContainerDied","Data":"982ab6887d084b5a20949eae196843051865a30c8a3b33feea9b6ad369ae03ee"}
Oct 30 22:28:18.670356 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:18.670140    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg" event={"ID":"f54dadd3-7c07-4eea-919c-1910ad1d6d66","Type":"ContainerStarted","Data":"0d64f131100eb1fb2b7cc649364ad910e30a896e517bb373e8ba4729789ebe14"}
Oct 30 22:28:19.808249 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.808224    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:19.834478 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.834454    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f54dadd3-7c07-4eea-919c-1910ad1d6d66-kube-api-access-hfv9k\" (UniqueName: \"kubernetes.io/projected/f54dadd3-7c07-4eea-919c-1910ad1d6d66-kube-api-access-hfv9k\") pod \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") "
Oct 30 22:28:19.834591 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.834523    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-xks-ca\") pod \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") "
Oct 30 22:28:19.834591 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.834579    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-openshift-ca\") pod \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\" (UID: \"f54dadd3-7c07-4eea-919c-1910ad1d6d66\") "
Oct 30 22:28:19.834963 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.834941    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-openshift-ca" pod "f54dadd3-7c07-4eea-919c-1910ad1d6d66" (UID: "f54dadd3-7c07-4eea-919c-1910ad1d6d66"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:28:19.836514 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.836489    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-xks-ca" pod "f54dadd3-7c07-4eea-919c-1910ad1d6d66" (UID: "f54dadd3-7c07-4eea-919c-1910ad1d6d66"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:28:19.836586 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.836512    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f54dadd3-7c07-4eea-919c-1910ad1d6d66-kube-api-access-hfv9k" pod "f54dadd3-7c07-4eea-919c-1910ad1d6d66" (UID: "f54dadd3-7c07-4eea-919c-1910ad1d6d66"). InnerVolumeSpecName "kube-api-access-hfv9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:28:19.935940 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.935873    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfv9k\" (UniqueName: \"kubernetes.io/projected/f54dadd3-7c07-4eea-919c-1910ad1d6d66-kube-api-access-hfv9k\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:19.935940 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.935910    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-xks-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:19.935940 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:19.935928    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f54dadd3-7c07-4eea-919c-1910ad1d6d66-maas-api-openshift-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:28:20.682240 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:20.682209    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"
Oct 30 22:28:20.682240 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:20.682232    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg" event={"ID":"f54dadd3-7c07-4eea-919c-1910ad1d6d66","Type":"ContainerDied","Data":"0d64f131100eb1fb2b7cc649364ad910e30a896e517bb373e8ba4729789ebe14"}
Oct 30 22:28:20.682448 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:20.682280    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d64f131100eb1fb2b7cc649364ad910e30a896e517bb373e8ba4729789ebe14"
Oct 30 22:28:21.062248 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:28:21.062170    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:28:22.314576 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:22.314518    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:27.044093 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:27.044059    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:29.017632 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:29.017596    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:29.196254 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:29.196225    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:36.314406 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:36.314370    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:37.882817 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:37.882783    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:38.124607 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:38.124543    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:38.417715 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:38.417681    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"]
Oct 30 22:28:38.466967 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:38.466929    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-authcfg-http-161f7a-6rhvg"]
Oct 30 22:28:38.901447 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:38.901408    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:39.616645 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:39.616610    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f54dadd3-7c07-4eea-919c-1910ad1d6d66" path="/var/lib/kubelet/pods/f54dadd3-7c07-4eea-919c-1910ad1d6d66/volumes"
Oct 30 22:28:44.866786 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:44.866747    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:45.058159 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:45.058111    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:45.244011 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:28:45.243975    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:28:51.061871 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:28:51.061821    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:29:00.619981 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:00.619929    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:13.134691 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.134651    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"]
Oct 30 22:29:13.135257 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.135236    4943 cpu_manager.go:414] "containerMap: removing container" podUID="f54dadd3-7c07-4eea-919c-1910ad1d6d66" containerName="revoke-keys"
Oct 30 22:29:13.135348 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.135259    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f54dadd3-7c07-4eea-919c-1910ad1d6d66" containerName="revoke-keys"
Oct 30 22:29:13.135403 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.135357    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="f54dadd3-7c07-4eea-919c-1910ad1d6d66" containerName="revoke-keys"
Oct 30 22:29:13.138371 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.138350    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.158528 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.158494    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsk7q\" (UniqueName: \"kubernetes.io/projected/eaa76f64-178e-4e7f-aac4-3921dff8e756-kube-api-access-wsk7q\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.158653 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.158537    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.158746 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.158724    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.196413 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.196388    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"]
Oct 30 22:29:13.242759 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.242725    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:29:13.242908 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.242777    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:29:13.242908 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.242790    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vq9dr\""
Oct 30 22:29:13.242908 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.242791    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:29:13.259526 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.259498    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.259674 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.259635    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.259717 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.259682    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsk7q\" (UniqueName: \"kubernetes.io/projected/eaa76f64-178e-4e7f-aac4-3921dff8e756-kube-api-access-wsk7q\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.260277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.260256    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.262166 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.262147    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.317175 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.317145    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsk7q\" (UniqueName: \"kubernetes.io/projected/eaa76f64-178e-4e7f-aac4-3921dff8e756-kube-api-access-wsk7q\") pod \"maas-api-revoke-sub-f03629db-fk5m5\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.451676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.451647    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:13.826521 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:13.826493    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"]
Oct 30 22:29:13.832256 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:29:13.832221    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa76f64_178e_4e7f_aac4_3921dff8e756.slice/crio-49081fff9d70e54850b3c820bbcd7fb7068381157d893d29ce24f7ebfa546c81 WatchSource:0}: Error finding container 49081fff9d70e54850b3c820bbcd7fb7068381157d893d29ce24f7ebfa546c81: Status 404 returned error can't find the container with id 49081fff9d70e54850b3c820bbcd7fb7068381157d893d29ce24f7ebfa546c81
Oct 30 22:29:14.046046 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:14.046007    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5" event={"ID":"eaa76f64-178e-4e7f-aac4-3921dff8e756","Type":"ContainerStarted","Data":"49081fff9d70e54850b3c820bbcd7fb7068381157d893d29ce24f7ebfa546c81"}
Oct 30 22:29:15.054282 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:15.054201    4943 generic.go:356] "Generic (PLEG): container finished" podID="eaa76f64-178e-4e7f-aac4-3921dff8e756" containerID="a1edabda6f505e21920a67275135a852b5d983c18663b7c9babe0f40af087162" exitCode=0
Oct 30 22:29:15.054696 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:15.054286    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5" event={"ID":"eaa76f64-178e-4e7f-aac4-3921dff8e756","Type":"ContainerDied","Data":"a1edabda6f505e21920a67275135a852b5d983c18663b7c9babe0f40af087162"}
Oct 30 22:29:15.311240 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:15.311163    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:15.495418 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:15.495369    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:16.189549 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.189525    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:16.281773 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.281747    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-openshift-ca\") pod \"eaa76f64-178e-4e7f-aac4-3921dff8e756\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") "
Oct 30 22:29:16.281899 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.281784    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eaa76f64-178e-4e7f-aac4-3921dff8e756-kube-api-access-wsk7q\" (UniqueName: \"kubernetes.io/projected/eaa76f64-178e-4e7f-aac4-3921dff8e756-kube-api-access-wsk7q\") pod \"eaa76f64-178e-4e7f-aac4-3921dff8e756\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") "
Oct 30 22:29:16.281899 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.281826    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-xks-ca\") pod \"eaa76f64-178e-4e7f-aac4-3921dff8e756\" (UID: \"eaa76f64-178e-4e7f-aac4-3921dff8e756\") "
Oct 30 22:29:16.282167 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.282144    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-openshift-ca" pod "eaa76f64-178e-4e7f-aac4-3921dff8e756" (UID: "eaa76f64-178e-4e7f-aac4-3921dff8e756"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:16.282233 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.282222    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-openshift-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:16.283957 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.283933    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-xks-ca" pod "eaa76f64-178e-4e7f-aac4-3921dff8e756" (UID: "eaa76f64-178e-4e7f-aac4-3921dff8e756"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:29:16.284008 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.283964    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaa76f64-178e-4e7f-aac4-3921dff8e756-kube-api-access-wsk7q" pod "eaa76f64-178e-4e7f-aac4-3921dff8e756" (UID: "eaa76f64-178e-4e7f-aac4-3921dff8e756"). InnerVolumeSpecName "kube-api-access-wsk7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:16.383359 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.383287    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsk7q\" (UniqueName: \"kubernetes.io/projected/eaa76f64-178e-4e7f-aac4-3921dff8e756-kube-api-access-wsk7q\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:16.383359 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:16.383321    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eaa76f64-178e-4e7f-aac4-3921dff8e756-maas-api-xks-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:17.066671 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:17.066640    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"
Oct 30 22:29:17.066857 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:17.066681    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5" event={"ID":"eaa76f64-178e-4e7f-aac4-3921dff8e756","Type":"ContainerDied","Data":"49081fff9d70e54850b3c820bbcd7fb7068381157d893d29ce24f7ebfa546c81"}
Oct 30 22:29:17.066857 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:17.066740    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49081fff9d70e54850b3c820bbcd7fb7068381157d893d29ce24f7ebfa546c81"
Oct 30 22:29:19.142764 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:19.142728    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:29:21.062070 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:29:21.062032    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:29:34.100759 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.100676    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"]
Oct 30 22:29:34.101222 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.101093    4943 cpu_manager.go:414] "containerMap: removing container" podUID="eaa76f64-178e-4e7f-aac4-3921dff8e756" containerName="revoke-keys"
Oct 30 22:29:34.101222 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.101104    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eaa76f64-178e-4e7f-aac4-3921dff8e756" containerName="revoke-keys"
Oct 30 22:29:34.101222 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.101167    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="eaa76f64-178e-4e7f-aac4-3921dff8e756" containerName="revoke-keys"
Oct 30 22:29:34.104139 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.104122    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.140972 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.140949    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4wqx\" (UniqueName: \"kubernetes.io/projected/3bd419db-2f80-413f-9d52-1a831e5482c7-kube-api-access-h4wqx\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.141104 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.140982    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.141104 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.141070    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.157905 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.157878    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:29:34.207355 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.207325    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:29:34.207529 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.207377    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vq9dr\""
Oct 30 22:29:34.207529 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.207377    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:29:34.209793 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.209769    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"]
Oct 30 22:29:34.242567 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.242536    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4wqx\" (UniqueName: \"kubernetes.io/projected/3bd419db-2f80-413f-9d52-1a831e5482c7-kube-api-access-h4wqx\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.242688 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.242589    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.242688 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.242620    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.243276 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.243258    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.244797 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.244780    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.299117 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.299087    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4wqx\" (UniqueName: \"kubernetes.io/projected/3bd419db-2f80-413f-9d52-1a831e5482c7-kube-api-access-h4wqx\") pod \"maas-api-revoke-sub-0165d7d2-hl2f7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.416917 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.416892    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:34.793683 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:34.793653    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"]
Oct 30 22:29:34.795471 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:29:34.795443    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd419db_2f80_413f_9d52_1a831e5482c7.slice/crio-e8009eab33a4278db785b1fb586392dac0d18b96e57687f3bc8525591420714a WatchSource:0}: Error finding container e8009eab33a4278db785b1fb586392dac0d18b96e57687f3bc8525591420714a: Status 404 returned error can't find the container with id e8009eab33a4278db785b1fb586392dac0d18b96e57687f3bc8525591420714a
Oct 30 22:29:35.204996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:35.204957    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7" event={"ID":"3bd419db-2f80-413f-9d52-1a831e5482c7","Type":"ContainerStarted","Data":"0e8ea8843521675b60a6cf8d4834dc16c20a203cff20d4bf387e0caa86e56c19"}
Oct 30 22:29:35.205464 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:35.205015    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7" event={"ID":"3bd419db-2f80-413f-9d52-1a831e5482c7","Type":"ContainerStarted","Data":"e8009eab33a4278db785b1fb586392dac0d18b96e57687f3bc8525591420714a"}
Oct 30 22:29:35.318451 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:35.318381    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7" podStartSLOduration=1.318363464 podStartE2EDuration="1.318363464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:29:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:29:35.317966653 +0000 UTC m=+4369.813540001" watchObservedRunningTime="2026-10-30 22:29:35.318363464 +0000 UTC m=+4369.813936816"
Oct 30 22:29:36.211737 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:36.211704    4943 generic.go:356] "Generic (PLEG): container finished" podID="3bd419db-2f80-413f-9d52-1a831e5482c7" containerID="0e8ea8843521675b60a6cf8d4834dc16c20a203cff20d4bf387e0caa86e56c19" exitCode=0
Oct 30 22:29:36.212136 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:36.211762    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7" event={"ID":"3bd419db-2f80-413f-9d52-1a831e5482c7","Type":"ContainerDied","Data":"0e8ea8843521675b60a6cf8d4834dc16c20a203cff20d4bf387e0caa86e56c19"}
Oct 30 22:29:37.349928 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.349903    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:37.472246 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.472176    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-openshift-ca\") pod \"3bd419db-2f80-413f-9d52-1a831e5482c7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") "
Oct 30 22:29:37.472246 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.472224    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3bd419db-2f80-413f-9d52-1a831e5482c7-kube-api-access-h4wqx\" (UniqueName: \"kubernetes.io/projected/3bd419db-2f80-413f-9d52-1a831e5482c7-kube-api-access-h4wqx\") pod \"3bd419db-2f80-413f-9d52-1a831e5482c7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") "
Oct 30 22:29:37.472454 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.472300    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-xks-ca\") pod \"3bd419db-2f80-413f-9d52-1a831e5482c7\" (UID: \"3bd419db-2f80-413f-9d52-1a831e5482c7\") "
Oct 30 22:29:37.472609 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.472585    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-openshift-ca" pod "3bd419db-2f80-413f-9d52-1a831e5482c7" (UID: "3bd419db-2f80-413f-9d52-1a831e5482c7"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:37.474324 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.474293    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-xks-ca" pod "3bd419db-2f80-413f-9d52-1a831e5482c7" (UID: "3bd419db-2f80-413f-9d52-1a831e5482c7"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:29:37.474427 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.474362    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd419db-2f80-413f-9d52-1a831e5482c7-kube-api-access-h4wqx" pod "3bd419db-2f80-413f-9d52-1a831e5482c7" (UID: "3bd419db-2f80-413f-9d52-1a831e5482c7"). InnerVolumeSpecName "kube-api-access-h4wqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:37.573389 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.573360    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-openshift-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:37.573389 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.573387    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4wqx\" (UniqueName: \"kubernetes.io/projected/3bd419db-2f80-413f-9d52-1a831e5482c7-kube-api-access-h4wqx\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:37.573536 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:37.573397    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3bd419db-2f80-413f-9d52-1a831e5482c7-maas-api-xks-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:38.224088 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:38.224057    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"
Oct 30 22:29:38.224250 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:38.224064    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7" event={"ID":"3bd419db-2f80-413f-9d52-1a831e5482c7","Type":"ContainerDied","Data":"e8009eab33a4278db785b1fb586392dac0d18b96e57687f3bc8525591420714a"}
Oct 30 22:29:38.224250 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:38.224193    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8009eab33a4278db785b1fb586392dac0d18b96e57687f3bc8525591420714a"
Oct 30 22:29:45.842923 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.842887    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"]
Oct 30 22:29:45.843295 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.843255    4943 cpu_manager.go:414] "containerMap: removing container" podUID="3bd419db-2f80-413f-9d52-1a831e5482c7" containerName="revoke-keys"
Oct 30 22:29:45.843295 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.843266    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3bd419db-2f80-413f-9d52-1a831e5482c7" containerName="revoke-keys"
Oct 30 22:29:45.843372 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.843354    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="3bd419db-2f80-413f-9d52-1a831e5482c7" containerName="revoke-keys"
Oct 30 22:29:45.846825 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.846803    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:45.900439 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.900412    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:29:45.944314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.944285    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:45.944468 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.944340    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbdcq\" (UniqueName: \"kubernetes.io/projected/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-kube-api-access-vbdcq\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:45.944511 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.944477    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:45.949670 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.949651    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 30 22:29:45.949801 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.949704    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:29:45.949801 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.949794    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vq9dr\""
Oct 30 22:29:45.952272 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:45.952241    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"]
Oct 30 22:29:46.045945 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.045915    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:46.046062 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.046018    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:46.046128 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.046071    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbdcq\" (UniqueName: \"kubernetes.io/projected/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-kube-api-access-vbdcq\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:46.046603 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.046581    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:46.048305 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.048288    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:46.102508 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.102448    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbdcq\" (UniqueName: \"kubernetes.io/projected/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-kube-api-access-vbdcq\") pod \"maas-api-revoke-sub-6b19338f-67z26\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:46.159909 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.159886    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:46.534242 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:46.534214    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"]
Oct 30 22:29:46.536706 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:29:46.536680    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2320ff_509a_450d_a6b4_cf9b75ef1d1b.slice/crio-416de31105bbe679ebe86ce26211c04dabd380e59dc0d9d0325db5f76861d3e4 WatchSource:0}: Error finding container 416de31105bbe679ebe86ce26211c04dabd380e59dc0d9d0325db5f76861d3e4: Status 404 returned error can't find the container with id 416de31105bbe679ebe86ce26211c04dabd380e59dc0d9d0325db5f76861d3e4
Oct 30 22:29:47.293338 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:47.293294    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26" event={"ID":"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b","Type":"ContainerStarted","Data":"3a3dc924bd82e31ef9f098ac503a350dfb71c68445add8ad11955fb4a0a70192"}
Oct 30 22:29:47.293878 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:47.293363    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26" event={"ID":"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b","Type":"ContainerStarted","Data":"416de31105bbe679ebe86ce26211c04dabd380e59dc0d9d0325db5f76861d3e4"}
Oct 30 22:29:47.409389 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:47.409332    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26" podStartSLOduration=2.409315288 podStartE2EDuration="2.409315288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:29:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:29:47.407173103 +0000 UTC m=+4381.902746455" watchObservedRunningTime="2026-10-30 22:29:47.409315288 +0000 UTC m=+4381.904888641"
Oct 30 22:29:48.300338 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:48.300305    4943 generic.go:356] "Generic (PLEG): container finished" podID="4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" containerID="3a3dc924bd82e31ef9f098ac503a350dfb71c68445add8ad11955fb4a0a70192" exitCode=0
Oct 30 22:29:48.300810 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:48.300432    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26" event={"ID":"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b","Type":"ContainerDied","Data":"3a3dc924bd82e31ef9f098ac503a350dfb71c68445add8ad11955fb4a0a70192"}
Oct 30 22:29:49.433492 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.433468    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:49.578082 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.578015    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-kube-api-access-vbdcq\" (UniqueName: \"kubernetes.io/projected/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-kube-api-access-vbdcq\") pod \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") "
Oct 30 22:29:49.578082 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.578067    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-xks-ca\") pod \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") "
Oct 30 22:29:49.578272 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.578199    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-openshift-ca\") pod \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\" (UID: \"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b\") "
Oct 30 22:29:49.578639 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.578607    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-openshift-ca" pod "4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" (UID: "4e2320ff-509a-450d-a6b4-cf9b75ef1d1b"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:29:49.580117 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.580092    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-xks-ca" pod "4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" (UID: "4e2320ff-509a-450d-a6b4-cf9b75ef1d1b"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 30 22:29:49.580232 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.580139    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-kube-api-access-vbdcq" pod "4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" (UID: "4e2320ff-509a-450d-a6b4-cf9b75ef1d1b"). InnerVolumeSpecName "kube-api-access-vbdcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:29:49.679943 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.679916    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-xks-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:49.679943 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.679940    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-maas-api-openshift-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:49.680100 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:49.679957    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbdcq\" (UniqueName: \"kubernetes.io/projected/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b-kube-api-access-vbdcq\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:29:50.312527 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:50.312497    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"
Oct 30 22:29:50.312715 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:50.312528    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26" event={"ID":"4e2320ff-509a-450d-a6b4-cf9b75ef1d1b","Type":"ContainerDied","Data":"416de31105bbe679ebe86ce26211c04dabd380e59dc0d9d0325db5f76861d3e4"}
Oct 30 22:29:50.312715 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:50.312594    4943 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="416de31105bbe679ebe86ce26211c04dabd380e59dc0d9d0325db5f76861d3e4"
Oct 30 22:29:51.061723 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:29:51.061681    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:29:57.943468 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:29:57.943436    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6896667454-bs2vb_f5b263bc-c9d1-49f0-90af-cb59569ec928/authorino/0.log"
Oct 30 22:30:00.187726 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.187689    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"]
Oct 30 22:30:00.188861 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.188833    4943 cpu_manager.go:414] "containerMap: removing container" podUID="4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" containerName="revoke-keys"
Oct 30 22:30:00.189010 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.188994    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" containerName="revoke-keys"
Oct 30 22:30:00.189296 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.189276    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" containerName="revoke-keys"
Oct 30 22:30:00.233323 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.233286    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"]
Oct 30 22:30:00.233625 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.233607    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.327141 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.327097    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-l6vlt\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.327465 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.327439    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z694\" (UniqueName: \"kubernetes.io/projected/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-kube-api-access-7z694\") pod \"maas-api-key-cleanup-29889990-l6vlt\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.327896 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.327874    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vq9dr\""
Oct 30 22:30:00.328014 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.327889    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 30 22:30:00.339460 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.339438    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 30 22:30:00.428477 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.428447    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-l6vlt\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.428702 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.428503    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z694\" (UniqueName: \"kubernetes.io/projected/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-kube-api-access-7z694\") pod \"maas-api-key-cleanup-29889990-l6vlt\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.429381 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.429354    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-maas-api-service-ca\") pod \"maas-api-key-cleanup-29889990-l6vlt\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.499627 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.499295    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z694\" (UniqueName: \"kubernetes.io/projected/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-kube-api-access-7z694\") pod \"maas-api-key-cleanup-29889990-l6vlt\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.603049 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.601743    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:00.967810 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:00.967771    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:01.030300 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:01.030265    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"]
Oct 30 22:30:01.031179 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:30:01.031154    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e0d365_d313_4bbe_85c2_c6e4b15a75bc.slice/crio-b0c9801c260d1d21b9ff42194e15cf79c78c4346bb56997418feb35d8ca3884d WatchSource:0}: Error finding container b0c9801c260d1d21b9ff42194e15cf79c78c4346bb56997418feb35d8ca3884d: Status 404 returned error can't find the container with id b0c9801c260d1d21b9ff42194e15cf79c78c4346bb56997418feb35d8ca3884d
Oct 30 22:30:01.423164 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:01.423127    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" event={"ID":"75e0d365-d313-4bbe-85c2-c6e4b15a75bc","Type":"ContainerStarted","Data":"9ffe38569daa8f7bbabb13882fd8ef2270ae7d50c477773af6853f261a2e6e68"}
Oct 30 22:30:01.423591 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:01.423181    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" event={"ID":"75e0d365-d313-4bbe-85c2-c6e4b15a75bc","Type":"ContainerStarted","Data":"b0c9801c260d1d21b9ff42194e15cf79c78c4346bb56997418feb35d8ca3884d"}
Oct 30 22:30:01.537428 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:01.537335    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" podStartSLOduration=1.537318867 podStartE2EDuration="1.537318867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-30 22:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:30:01.535244498 +0000 UTC m=+4396.030817849" watchObservedRunningTime="2026-10-30 22:30:01.537318867 +0000 UTC m=+4396.032892225"
Oct 30 22:30:02.430325 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:02.430287    4943 generic.go:356] "Generic (PLEG): container finished" podID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerID="9ffe38569daa8f7bbabb13882fd8ef2270ae7d50c477773af6853f261a2e6e68" exitCode=60
Oct 30 22:30:02.430857 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:02.430366    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" event={"ID":"75e0d365-d313-4bbe-85c2-c6e4b15a75bc","Type":"ContainerDied","Data":"9ffe38569daa8f7bbabb13882fd8ef2270ae7d50c477773af6853f261a2e6e68"}
Oct 30 22:30:02.430857 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:02.430644    4943 scope.go:122] "RemoveContainer" containerID="9ffe38569daa8f7bbabb13882fd8ef2270ae7d50c477773af6853f261a2e6e68"
Oct 30 22:30:03.438169 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:03.438130    4943 generic.go:356] "Generic (PLEG): container finished" podID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerID="dc3ae81ee5e868f2b75591781cae57e8dbb4b363a7867f0c808f78c3ed46432b" exitCode=60
Oct 30 22:30:03.438602 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:03.438206    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" event={"ID":"75e0d365-d313-4bbe-85c2-c6e4b15a75bc","Type":"ContainerDied","Data":"dc3ae81ee5e868f2b75591781cae57e8dbb4b363a7867f0c808f78c3ed46432b"}
Oct 30 22:30:03.438602 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:03.438269    4943 scope.go:122] "RemoveContainer" containerID="9ffe38569daa8f7bbabb13882fd8ef2270ae7d50c477773af6853f261a2e6e68"
Oct 30 22:30:03.438602 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:03.438469    4943 scope.go:122] "RemoveContainer" containerID="dc3ae81ee5e868f2b75591781cae57e8dbb4b363a7867f0c808f78c3ed46432b"
Oct 30 22:30:03.438749 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:30:03.438735    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-l6vlt_odh-ai-gateway-infra(75e0d365-d313-4bbe-85c2-c6e4b15a75bc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc"
Oct 30 22:30:04.445491 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:04.445453    4943 scope.go:122] "RemoveContainer" containerID="dc3ae81ee5e868f2b75591781cae57e8dbb4b363a7867f0c808f78c3ed46432b"
Oct 30 22:30:04.445874 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:30:04.445700    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-l6vlt_odh-ai-gateway-infra(75e0d365-d313-4bbe-85c2-c6e4b15a75bc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc"
Oct 30 22:30:16.611921 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:16.611892    4943 scope.go:122] "RemoveContainer" containerID="dc3ae81ee5e868f2b75591781cae57e8dbb4b363a7867f0c808f78c3ed46432b"
Oct 30 22:30:17.516640 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:17.516611    4943 generic.go:356] "Generic (PLEG): container finished" podID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerID="f4e402c866ae7d2125cc1614d1a0c2019df718496d5ac259076fd03cf81e807b" exitCode=60
Oct 30 22:30:17.516799 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:17.516684    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" event={"ID":"75e0d365-d313-4bbe-85c2-c6e4b15a75bc","Type":"ContainerDied","Data":"f4e402c866ae7d2125cc1614d1a0c2019df718496d5ac259076fd03cf81e807b"}
Oct 30 22:30:17.516799 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:17.516745    4943 scope.go:122] "RemoveContainer" containerID="dc3ae81ee5e868f2b75591781cae57e8dbb4b363a7867f0c808f78c3ed46432b"
Oct 30 22:30:17.517069 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:17.517050    4943 scope.go:122] "RemoveContainer" containerID="f4e402c866ae7d2125cc1614d1a0c2019df718496d5ac259076fd03cf81e807b"
Oct 30 22:30:17.517339 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:30:17.517307    4943 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29889990-l6vlt_odh-ai-gateway-infra(75e0d365-d313-4bbe-85c2-c6e4b15a75bc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc"
Oct 30 22:30:18.642602 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:18.642568    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"]
Oct 30 22:30:18.781718 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:18.781689    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:18.908270 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:18.908241    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-kube-api-access-7z694\" (UniqueName: \"kubernetes.io/projected/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-kube-api-access-7z694\") pod \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") "
Oct 30 22:30:18.908460 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:18.908393    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-maas-api-service-ca\") pod \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\" (UID: \"75e0d365-d313-4bbe-85c2-c6e4b15a75bc\") "
Oct 30 22:30:18.908918 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:18.908894    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-maas-api-service-ca" pod "75e0d365-d313-4bbe-85c2-c6e4b15a75bc" (UID: "75e0d365-d313-4bbe-85c2-c6e4b15a75bc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:30:18.910580 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:18.910525    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-kube-api-access-7z694" pod "75e0d365-d313-4bbe-85c2-c6e4b15a75bc" (UID: "75e0d365-d313-4bbe-85c2-c6e4b15a75bc"). InnerVolumeSpecName "kube-api-access-7z694". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:30:19.009633 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:19.009602    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7z694\" (UniqueName: \"kubernetes.io/projected/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-kube-api-access-7z694\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.009633 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:19.009629    4943 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/75e0d365-d313-4bbe-85c2-c6e4b15a75bc-maas-api-service-ca\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:30:19.531845 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:19.531813    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt" event={"ID":"75e0d365-d313-4bbe-85c2-c6e4b15a75bc","Type":"ContainerDied","Data":"b0c9801c260d1d21b9ff42194e15cf79c78c4346bb56997418feb35d8ca3884d"}
Oct 30 22:30:19.532039 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:19.531876    4943 scope.go:122] "RemoveContainer" containerID="f4e402c866ae7d2125cc1614d1a0c2019df718496d5ac259076fd03cf81e807b"
Oct 30 22:30:19.532039 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:19.531821    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"
Oct 30 22:30:19.695571 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:19.695531    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"]
Oct 30 22:30:19.744786 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:19.744758    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29889990-l6vlt"]
Oct 30 22:30:21.062471 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:30:21.062439    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:30:21.617020 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:21.616983    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" path="/var/lib/kubelet/pods/75e0d365-d313-4bbe-85c2-c6e4b15a75bc/volumes"
Oct 30 22:30:29.692437 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:29.692405    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-fhcnj_5128c700-687b-465d-b116-549dc7ec9074/manager/0.log"
Oct 30 22:30:30.062938 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:30.062848    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-z8m9g_d931a613-5a33-4403-83f9-a81d96e2bb19/manager/0.log"
Oct 30 22:30:31.576930 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:31.576895    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-6rnx4_d19bb9ca-7514-4908-84eb-334ff4e55594/proxy/0.log"
Oct 30 22:30:32.992113 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:32.992078    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-hl2f7_3bd419db-2f80-413f-9d52-1a831e5482c7/revoke-keys/0.log"
Oct 30 22:30:43.218946 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:43.218916    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-67z26_4e2320ff-509a-450d-a6b4-cf9b75ef1d1b/revoke-keys/0.log"
Oct 30 22:30:43.448310 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:43.448279    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-fk5m5_eaa76f64-178e-4e7f-aac4-3921dff8e756/revoke-keys/0.log"
Oct 30 22:30:43.547398 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:43.547314    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:43.732691 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:43.732657    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:45.297965 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:45.297936    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6896667454-bs2vb_f5b263bc-c9d1-49f0-90af-cb59569ec928/authorino/0.log"
Oct 30 22:30:45.356364 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:45.356330    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:30:45.769415 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:45.769382    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-h8k2b_68d9c8f8-4f03-4869-a585-a809aa938336/manager/0.log"
Oct 30 22:30:46.015567 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:30:46.015528    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-mvxnn_98a6dbff-dd7d-4aa3-8813-99df235c43e0/manager/0.log"
Oct 30 22:30:51.062289 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:30:51.062251    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:31:01.330232 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:01.330155    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:31:07.342774 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:07.342740    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-42fbr_c9d7a056-f88a-470c-9b0a-6acc8acce466/manager/0.log"
Oct 30 22:31:08.327615 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:08.327581    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z_ff8eb018-788a-4b5c-a68c-2606ac78b5f3/istio-proxy/0.log"
Oct 30 22:31:08.557947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:08.557916    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-4hmln_8962662a-bba0-49a1-9440-eb69857c34c4/discovery/0.log"
Oct 30 22:31:09.590680 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:09.590641    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f694df8bc-dqh7x_9fac9883-4c89-47e4-aabc-30e1c220b302/istio-proxy/0.log"
Oct 30 22:31:09.868510 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:09.868434    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f694df8bc-dtz5k_9763f27b-1cdc-4372-a67e-e9cd17208e2a/istio-proxy/0.log"
Oct 30 22:31:21.061981 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:31:21.061943    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:31:21.413393 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:21.413362    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f694df8bc-rjrrx_b117fb6b-a40b-497b-a211-4507a59683e8/istio-proxy/0.log"
Oct 30 22:31:21.919804 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:21.919778    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq_501d7ec4-1e74-452b-a771-8acfad8bd664/istio-proxy/0.log"
Oct 30 22:31:22.679633 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:22.679603    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d7bfbd7bc-slk74_43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/router/0.log"
Oct 30 22:31:26.272191 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:26.272157    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6896667454-bs2vb_f5b263bc-c9d1-49f0-90af-cb59569ec928/authorino/0.log"
Oct 30 22:31:46.376137 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:46.376106    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:31:46.385474 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:46.385452    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:31:46.794685 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:31:46.794648    4943 scope.go:122] "RemoveContainer" containerID="43e2397bbb3c8fdf3dc00e42b57a10085201c5d122ab986fad0af73d6cf24915"
Oct 30 22:31:51.061737 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:31:51.061703    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:32:01.645950 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:01.645913    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:32:06.209897 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:06.209864    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-fhcnj_5128c700-687b-465d-b116-549dc7ec9074/manager/0.log"
Oct 30 22:32:06.593187 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:06.593109    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-z8m9g_d931a613-5a33-4403-83f9-a81d96e2bb19/manager/0.log"
Oct 30 22:32:07.761734 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:07.761706    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-6rnx4_d19bb9ca-7514-4908-84eb-334ff4e55594/proxy/0.log"
Oct 30 22:32:18.958435 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:18.958404    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-0165d7d2-hl2f7_3bd419db-2f80-413f-9d52-1a831e5482c7/revoke-keys/0.log"
Oct 30 22:32:19.195736 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:19.195705    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6b19338f-67z26_4e2320ff-509a-450d-a6b4-cf9b75ef1d1b/revoke-keys/0.log"
Oct 30 22:32:19.426848 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:19.426814    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f03629db-fk5m5_eaa76f64-178e-4e7f-aac4-3921dff8e756/revoke-keys/0.log"
Oct 30 22:32:20.818233 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:20.818201    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6896667454-bs2vb_f5b263bc-c9d1-49f0-90af-cb59569ec928/authorino/0.log"
Oct 30 22:32:21.062712 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:32:21.062679    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:32:31.293104 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:31.293016    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-h8k2b_68d9c8f8-4f03-4869-a585-a809aa938336/manager/0.log"
Oct 30 22:32:41.621090 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:41.621058    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-mvxnn_98a6dbff-dd7d-4aa3-8813-99df235c43e0/manager/0.log"
Oct 30 22:32:42.852292 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:42.852262    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-42fbr_c9d7a056-f88a-470c-9b0a-6acc8acce466/manager/0.log"
Oct 30 22:32:43.602226 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:43.602191    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6fd5fcc55cdwj6z_ff8eb018-788a-4b5c-a68c-2606ac78b5f3/istio-proxy/0.log"
Oct 30 22:32:43.817780 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:43.817749    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-7ddd9cfdc8-4hmln_8962662a-bba0-49a1-9440-eb69857c34c4/discovery/0.log"
Oct 30 22:32:44.816747 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:44.816714    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f694df8bc-dqh7x_9fac9883-4c89-47e4-aabc-30e1c220b302/istio-proxy/0.log"
Oct 30 22:32:45.084628 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:45.084536    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f694df8bc-dtz5k_9763f27b-1cdc-4372-a67e-e9cd17208e2a/istio-proxy/0.log"
Oct 30 22:32:51.062208 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:32:51.062118    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:32:56.606676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:56.606640    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7f694df8bc-rjrrx_b117fb6b-a40b-497b-a211-4507a59683e8/istio-proxy/0.log"
Oct 30 22:32:57.176390 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:57.176355    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-7cc4b68895-zhkwq_501d7ec4-1e74-452b-a771-8acfad8bd664/istio-proxy/0.log"
Oct 30 22:32:57.882947 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:32:57.882913    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d7bfbd7bc-slk74_43aedfd0-4a10-4c6e-8ff4-c79f457d1aab/router/0.log"
Oct 30 22:33:02.055354 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:33:02.055321    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:04.120396 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:33:04.120338    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:19.871676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:33:19.871634    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:33:21.062270 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:33:21.062234    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:33:51.063226 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:33:51.063188    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:34:02.315754 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:02.315667    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:34:17.061983 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:17.061948    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"]
Oct 30 22:34:17.109626 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:17.109597    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f03629db-fk5m5"]
Oct 30 22:34:17.617881 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:17.617845    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eaa76f64-178e-4e7f-aac4-3921dff8e756" path="/var/lib/kubelet/pods/eaa76f64-178e-4e7f-aac4-3921dff8e756/volumes"
Oct 30 22:34:21.062063 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:34:21.062028    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:34:38.059995 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:38.059963    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"]
Oct 30 22:34:38.109422 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:38.109390    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-0165d7d2-hl2f7"]
Oct 30 22:34:39.616999 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:39.616969    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3bd419db-2f80-413f-9d52-1a831e5482c7" path="/var/lib/kubelet/pods/3bd419db-2f80-413f-9d52-1a831e5482c7/volumes"
Oct 30 22:34:46.836987 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:46.836955    4943 scope.go:122] "RemoveContainer" containerID="982ab6887d084b5a20949eae196843051865a30c8a3b33feea9b6ad369ae03ee"
Oct 30 22:34:50.048039 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:50.048002    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"]
Oct 30 22:34:50.097107 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:50.097075    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6b19338f-67z26"]
Oct 30 22:34:51.061493 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:34:51.061459    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:34:51.617182 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:34:51.617147    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4e2320ff-509a-450d-a6b4-cf9b75ef1d1b" path="/var/lib/kubelet/pods/4e2320ff-509a-450d-a6b4-cf9b75ef1d1b/volumes"
Oct 30 22:35:02.695250 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:02.695210    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:21.062013 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:35:21.061973    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:35:30.897018 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:30.896932    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"]
Oct 30 22:35:30.897549 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:30.897183    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy" containerID="cri-o://72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0" gracePeriod=30
Oct 30 22:35:30.946798 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:30.946765    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"]
Oct 30 22:35:30.947053 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:30.947006    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy" containerID="cri-o://ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e" gracePeriod=30
Oct 30 22:35:30.948860 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:30.948833    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"]
Oct 30 22:35:31.238783 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:31.238741    4943 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy" containerID="cri-o://6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2" gracePeriod=30
Oct 30 22:35:36.200129 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.200103    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:35:36.223758 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.223738    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:35:36.266939 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.266914    4943 generic.go:356] "Generic (PLEG): container finished" podID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerID="72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0" exitCode=0
Oct 30 22:35:36.267163 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.266971    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"
Oct 30 22:35:36.267163 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.266996    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" event={"ID":"9fac9883-4c89-47e4-aabc-30e1c220b302","Type":"ContainerDied","Data":"72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0"}
Oct 30 22:35:36.267163 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.267051    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x" event={"ID":"9fac9883-4c89-47e4-aabc-30e1c220b302","Type":"ContainerDied","Data":"686bc5ae7a47293d409a6567834bc6c04c4934665548668ca032f5dc62229253"}
Oct 30 22:35:36.267163 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.267078    4943 scope.go:122] "RemoveContainer" containerID="72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0"
Oct 30 22:35:36.268363 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.268341    4943 generic.go:356] "Generic (PLEG): container finished" podID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerID="ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e" exitCode=0
Oct 30 22:35:36.268467 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.268367    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" event={"ID":"9763f27b-1cdc-4372-a67e-e9cd17208e2a","Type":"ContainerDied","Data":"ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e"}
Oct 30 22:35:36.268467 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.268395    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"
Oct 30 22:35:36.268467 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.268414    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k" event={"ID":"9763f27b-1cdc-4372-a67e-e9cd17208e2a","Type":"ContainerDied","Data":"aaac5502b325f6458582996057dd18e331354bc3c3c5a723bd388b344dcc3a67"}
Oct 30 22:35:36.278760 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.278744    4943 scope.go:122] "RemoveContainer" containerID="72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0"
Oct 30 22:35:36.279056 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:35:36.279036    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0\": container with ID starting with 72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0 not found: ID does not exist" containerID="72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0"
Oct 30 22:35:36.279107 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.279065    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0"} err="failed to get container status \"72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0\": rpc error: code = NotFound desc = could not find container \"72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0\": container with ID starting with 72de0088bf598a011c52eb2e9df36fd136494271faf3ed9aeb81a93005c0bff0 not found: ID does not exist"
Oct 30 22:35:36.279107 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.279082    4943 scope.go:122] "RemoveContainer" containerID="ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e"
Oct 30 22:35:36.293371 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293343    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-socket\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293453 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293381    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-podinfo\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293453 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293442    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-data\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293527 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293461    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fac9883-4c89-47e4-aabc-30e1c220b302-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fac9883-4c89-47e4-aabc-30e1c220b302-istiod-ca-cert\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293527 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293497    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-envoy\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293614 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293544    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-certs\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293656 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293618    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-socket" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.293656 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293626    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-token\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-token\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293749 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293680    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-kube-api-access-9v46z\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-kube-api-access-9v46z\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293803 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293742    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-credential-socket\") pod \"9fac9883-4c89-47e4-aabc-30e1c220b302\" (UID: \"9fac9883-4c89-47e4-aabc-30e1c220b302\") "
Oct 30 22:35:36.293859 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293845    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-data" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.293917 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293871    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fac9883-4c89-47e4-aabc-30e1c220b302-istiod-ca-cert" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:36.293988 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.293967    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-certs" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.294159 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.294130    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.294232 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.294164    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.294232 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.294179    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fac9883-4c89-47e4-aabc-30e1c220b302-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.294232 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.294193    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.294392 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.294291    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-credential-socket" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.295812 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.295788    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-kube-api-access-9v46z" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "kube-api-access-9v46z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:36.296036 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.296015    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-envoy" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.296302 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.296283    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-token" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:36.296302 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.296292    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-podinfo" pod "9fac9883-4c89-47e4-aabc-30e1c220b302" (UID: "9fac9883-4c89-47e4-aabc-30e1c220b302"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:35:36.350443 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.350423    4943 scope.go:122] "RemoveContainer" containerID="ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e"
Oct 30 22:35:36.350778 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:35:36.350755    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e\": container with ID starting with ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e not found: ID does not exist" containerID="ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e"
Oct 30 22:35:36.350861 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.350786    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e"} err="failed to get container status \"ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e\": rpc error: code = NotFound desc = could not find container \"ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e\": container with ID starting with ee2b20a84d7c58a049afb0ab6c9a7ffa5a42178adf9e6f0cb7e67dd10f2ad23e not found: ID does not exist"
Oct 30 22:35:36.394847 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.394813    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istiod-ca-cert\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395045 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.394885    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-envoy\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395045 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.394921    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-credential-socket\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395045 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.394946    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-data\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395045 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.394984    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-podinfo\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395052    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-certs\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395083    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-token\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-token\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395157    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-kube-api-access-dqm7r\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-kube-api-access-dqm7r\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395193    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-socket\") pod \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\" (UID: \"9763f27b-1cdc-4372-a67e-e9cd17208e2a\") "
Oct 30 22:35:36.395521 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395510    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.395597 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395529    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.395597 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395546    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v46z\" (UniqueName: \"kubernetes.io/projected/9fac9883-4c89-47e4-aabc-30e1c220b302-kube-api-access-9v46z\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.395714 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395598    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fac9883-4c89-47e4-aabc-30e1c220b302-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.395714 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395612    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fac9883-4c89-47e4-aabc-30e1c220b302-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.395882 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.395862    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-socket" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.396162 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.396144    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istiod-ca-cert" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:36.396759 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.396729    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-credential-socket" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.396886 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.396838    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-certs" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.396951 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.396902    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-data" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.398767 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.398742    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-envoy" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.398871 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.398764    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-kube-api-access-dqm7r" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "kube-api-access-dqm7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:36.398871 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.398856    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-podinfo" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:35:36.398996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.398957    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-token" pod "9763f27b-1cdc-4372-a67e-e9cd17208e2a" (UID: "9763f27b-1cdc-4372-a67e-e9cd17208e2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:36.478689 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.478664    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:35:36.496907 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496883    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.496907 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496908    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.497081 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496917    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.497081 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496925    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.497081 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496935    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.497081 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496943    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.497081 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496951    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9763f27b-1cdc-4372-a67e-e9cd17208e2a-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.497081 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496961    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.497081 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.496969    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqm7r\" (UniqueName: \"kubernetes.io/projected/9763f27b-1cdc-4372-a67e-e9cd17208e2a-kube-api-access-dqm7r\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.597820 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.597788    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b117fb6b-a40b-497b-a211-4507a59683e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b117fb6b-a40b-497b-a211-4507a59683e8-istio-podinfo\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.597945 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.597855    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-socket\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.597945 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.597904    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-credential-socket\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.597945 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.597939    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-certs\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.598118 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.597984    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-kube-api-access-st48n\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-kube-api-access-st48n\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.598118 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598018    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-data\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.598118 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598047    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-envoy\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.598118 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598091    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-istio-token\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-istio-token\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.598396 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598170    4943 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b117fb6b-a40b-497b-a211-4507a59683e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b117fb6b-a40b-497b-a211-4507a59683e8-istiod-ca-cert\") pod \"b117fb6b-a40b-497b-a211-4507a59683e8\" (UID: \"b117fb6b-a40b-497b-a211-4507a59683e8\") "
Oct 30 22:35:36.598396 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598179    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-socket" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.598396 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598254    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-credential-socket" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.598396 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598270    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-certs" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.598662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598485    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-data" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.598662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598537    4943 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-credential-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.598662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598643    4943 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-certs\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.598662 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598660    4943 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-workload-socket\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.598837 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.598688    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b117fb6b-a40b-497b-a211-4507a59683e8-istiod-ca-cert" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 30 22:35:36.600256 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.600233    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-istio-token" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:36.600256 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.600239    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-envoy" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 30 22:35:36.600455 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.600434    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b117fb6b-a40b-497b-a211-4507a59683e8-istio-podinfo" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 30 22:35:36.600504 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.600435    4943 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-kube-api-access-st48n" pod "b117fb6b-a40b-497b-a211-4507a59683e8" (UID: "b117fb6b-a40b-497b-a211-4507a59683e8"). InnerVolumeSpecName "kube-api-access-st48n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 30 22:35:36.699611 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.699578    4943 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b117fb6b-a40b-497b-a211-4507a59683e8-istio-podinfo\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.699611 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.699607    4943 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st48n\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-kube-api-access-st48n\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.699611 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.699617    4943 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-data\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.699831 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.699625    4943 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b117fb6b-a40b-497b-a211-4507a59683e8-istio-envoy\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.699831 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.699634    4943 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b117fb6b-a40b-497b-a211-4507a59683e8-istio-token\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.699831 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.699642    4943 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b117fb6b-a40b-497b-a211-4507a59683e8-istiod-ca-cert\") on node \"ip-10-0-135-205.us-west-1.compute.internal\" DevicePath \"\""
Oct 30 22:35:36.768709 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.768633    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"]
Oct 30 22:35:36.778658 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.778627    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dqh7x"]
Oct 30 22:35:36.887083 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.887057    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"]
Oct 30 22:35:36.893848 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:36.893823    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-dtz5k"]
Oct 30 22:35:37.278303 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.278270    4943 generic.go:356] "Generic (PLEG): container finished" podID="b117fb6b-a40b-497b-a211-4507a59683e8" containerID="6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2" exitCode=0
Oct 30 22:35:37.278806 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.278332    4943 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"
Oct 30 22:35:37.278806 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.278362    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" event={"ID":"b117fb6b-a40b-497b-a211-4507a59683e8","Type":"ContainerDied","Data":"6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2"}
Oct 30 22:35:37.278806 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.278465    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx" event={"ID":"b117fb6b-a40b-497b-a211-4507a59683e8","Type":"ContainerDied","Data":"d1109a0dcd0cfaa26099fbb57d102c10b1a53a200df8b6573596ac43dedb5840"}
Oct 30 22:35:37.278806 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.278501    4943 scope.go:122] "RemoveContainer" containerID="6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2"
Oct 30 22:35:37.288131 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.288112    4943 scope.go:122] "RemoveContainer" containerID="6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2"
Oct 30 22:35:37.288370 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:35:37.288352    4943 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2\": container with ID starting with 6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2 not found: ID does not exist" containerID="6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2"
Oct 30 22:35:37.288411 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.288378    4943 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2"} err="failed to get container status \"6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2\": rpc error: code = NotFound desc = could not find container \"6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2\": container with ID starting with 6c4f06e37a13887694fa1b5acb2a6366945cb8b8f41a60ccab3fc314ab6d68e2 not found: ID does not exist"
Oct 30 22:35:37.442750 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.442725    4943 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"]
Oct 30 22:35:37.449146 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.449126    4943 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7f694df8bc-rjrrx"]
Oct 30 22:35:37.618058 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.617985    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" path="/var/lib/kubelet/pods/9763f27b-1cdc-4372-a67e-e9cd17208e2a/volumes"
Oct 30 22:35:37.618430 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.618416    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" path="/var/lib/kubelet/pods/9fac9883-4c89-47e4-aabc-30e1c220b302/volumes"
Oct 30 22:35:37.618830 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:37.618818    4943 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" path="/var/lib/kubelet/pods/b117fb6b-a40b-497b-a211-4507a59683e8/volumes"
Oct 30 22:35:46.859646 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:46.859613    4943 scope.go:122] "RemoveContainer" containerID="3a3dc924bd82e31ef9f098ac503a350dfb71c68445add8ad11955fb4a0a70192"
Oct 30 22:35:46.868314 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:46.868292    4943 scope.go:122] "RemoveContainer" containerID="a1edabda6f505e21920a67275135a852b5d983c18663b7c9babe0f40af087162"
Oct 30 22:35:46.875956 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:46.875937    4943 scope.go:122] "RemoveContainer" containerID="0e8ea8843521675b60a6cf8d4834dc16c20a203cff20d4bf387e0caa86e56c19"
Oct 30 22:35:51.062329 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:35:51.062287    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:35:54.544219 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:54.544186    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:35:55.448222 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:35:55.448161    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:02.993434 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:36:02.993399    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:12.222669 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:36:12.222614    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:36:21.061591 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:36:21.061542    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:36:46.411193 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:36:46.411162    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:36:46.425184 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:36:46.425161    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-2vz6h_2bcb4b95-cf9f-4cd5-8628-4d716078026d/console-operator/2.log"
Oct 30 22:36:51.062650 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:36:51.062618    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:37:03.330214 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:03.330128    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:21.061434 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:37:21.061399    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:37:33.893996 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:33.893962    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:34.094975 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:34.094939    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:37:42.663379 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:42.663345    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2g9kx_26f80d0e-54bd-400f-9b86-7103ea34895a/global-pull-secret-syncer/0.log"
Oct 30 22:37:44.551364 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:44.551336    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-mdw62_f6248f5b-93ea-43c6-8a91-ab757ba777fa/connection-checker/0.log"
Oct 30 22:37:44.965973 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:44.965942    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-spg6c_b9bc359e-dff6-4151-9210-553cb6cb727f/connection-checker/0.log"
Oct 30 22:37:45.380579 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:45.380491    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-vmw5p_7c10ba3d-7759-4577-b5d6-d7da68fa9768/connection-checker/0.log"
Oct 30 22:37:45.828676 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:45.828631    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log"
Oct 30 22:37:47.645716 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:37:47.645685    4943 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-205.us-west-1.compute.internal_61a83213484fa2827d610c578ff6f296/haproxy/0.log"
Oct 30 22:37:51.062508 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:37:51.062466    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:38:03.718692 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:03.718653    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:04.904454 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:04.904423    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:21.065885 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:38:21.065831    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"
Oct 30 22:38:25.012331 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:25.012292    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:25.788109 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:25.788067    4943 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6pzlh_5c962c0c-1334-4201-9a36-7e7bcc454f8d/konnectivity-agent/0.log" limit=1024
Oct 30 22:38:31.141784 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.141700    4943 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"]
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142085    4943 cpu_manager.go:414] "containerMap: removing container" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142095    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142110    4943 cpu_manager.go:414] "containerMap: removing container" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerName="cleanup"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142115    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerName="cleanup"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142141    4943 cpu_manager.go:414] "containerMap: removing container" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142147    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142156    4943 cpu_manager.go:414] "containerMap: removing container" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142161    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142169    4943 cpu_manager.go:414] "containerMap: removing container" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerName="cleanup"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142173    4943 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerName="cleanup"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142229    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="9763f27b-1cdc-4372-a67e-e9cd17208e2a" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142239    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerName="cleanup"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142247    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="75e0d365-d313-4bbe-85c2-c6e4b15a75bc" containerName="cleanup"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142252    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="b117fb6b-a40b-497b-a211-4507a59683e8" containerName="istio-proxy"
Oct 30 22:38:31.142277 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.142259    4943 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fac9883-4c89-47e4-aabc-30e1c220b302" containerName="istio-proxy"
Oct 30 22:38:31.145273 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.145253    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.200350 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.200321    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv8bk\" (UniqueName: \"kubernetes.io/projected/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-kube-api-access-nv8bk\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.200469 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.200359    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-lib-modules\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.200469 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.200384    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-podres\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.200469 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.200440    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-proc\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.200654 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.200632    4943 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-sys\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.247836 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.247815    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tlnnt\"/\"kube-root-ca.crt\""
Oct 30 22:38:31.248042 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.248025    4943 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tlnnt\"/\"openshift-service-ca.crt\""
Oct 30 22:38:31.248096 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.248028    4943 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tlnnt\"/\"default-dockercfg-w9mvk\""
Oct 30 22:38:31.250178 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.250160    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"]
Oct 30 22:38:31.301507 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301483    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv8bk\" (UniqueName: \"kubernetes.io/projected/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-kube-api-access-nv8bk\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301650 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301513    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-lib-modules\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301650 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301537    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-podres\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301650 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301578    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-proc\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301650 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301628    4943 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-sys\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301808 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301645    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-lib-modules\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301808 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301662    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-podres\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301808 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301718    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-sys\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.301808 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.301719    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-proc\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.357823 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.357800    4943 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv8bk\" (UniqueName: \"kubernetes.io/projected/4fe3f7f9-b6fa-4acf-9718-b92152862ea0-kube-api-access-nv8bk\") pod \"perf-node-gather-daemonset-mr7hz\" (UID: \"4fe3f7f9-b6fa-4acf-9718-b92152862ea0\") " pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.458357 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.458330    4943 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:31.833793 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:31.833749    4943 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"]
Oct 30 22:38:31.836317 ip-10-0-135-205 kubenswrapper[4943]: W1030 22:38:31.836287    4943 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4fe3f7f9_b6fa_4acf_9718_b92152862ea0.slice/crio-763221cb1d6d4074f3e04e037eba713d70ae02eb1ff4990ff3fe914621f72ba2 WatchSource:0}: Error finding container 763221cb1d6d4074f3e04e037eba713d70ae02eb1ff4990ff3fe914621f72ba2: Status 404 returned error can't find the container with id 763221cb1d6d4074f3e04e037eba713d70ae02eb1ff4990ff3fe914621f72ba2
Oct 30 22:38:32.157841 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:32.157805    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz" event={"ID":"4fe3f7f9-b6fa-4acf-9718-b92152862ea0","Type":"ContainerStarted","Data":"76c1dc3202daaa6c1f289fe841d7e99a4243c0b5a10c54bf6de02c9499742355"}
Oct 30 22:38:32.158305 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:32.157857    4943 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz" event={"ID":"4fe3f7f9-b6fa-4acf-9718-b92152862ea0","Type":"ContainerStarted","Data":"763221cb1d6d4074f3e04e037eba713d70ae02eb1ff4990ff3fe914621f72ba2"}
Oct 30 22:38:32.158305 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:32.157941    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:32.273893 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:32.273844    4943 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz" podStartSLOduration=1.273830909 podStartE2EDuration="1.273830909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-30 22:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-30 22:38:32.271609016 +0000 UTC m=+4906.767182358" watchObservedRunningTime="2026-10-30 22:38:32.273830909 +0000 UTC m=+4906.769404282"
Oct 30 22:38:38.172960 ip-10-0-135-205 kubenswrapper[4943]: I1030 22:38:38.172929    4943 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tlnnt/perf-node-gather-daemonset-mr7hz"
Oct 30 22:38:51.061100 ip-10-0-135-205 kubenswrapper[4943]: E1030 22:38:51.061062    4943 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-57nxn" containerName="extractor"